[ 582.078180] env[69506]: INFO neutron.common.config [-] Logging enabled! [ 582.080105] env[69506]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 26.1.0.dev35 [ 582.080105] env[69506]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69506) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 582.080105] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 582.080105] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 582.080105] env[69506]: WARNING oslo_policy.policy [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 582.080105] env[69506]: WARNING oslo_policy.policy [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 582.081622] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] VMware NSXv3 Agent initialized successfully. [ 582.084019] env[69506]: DEBUG oslo_concurrency.lockutils [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] Acquiring lock "singleton_lock" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.084019] env[69506]: DEBUG oslo_concurrency.lockutils [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] Acquired lock "singleton_lock" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.084019] env[69506]: DEBUG oslo_concurrency.lockutils [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] Releasing lock "singleton_lock" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.084019] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] Full set of CONF: {{(pid=69506) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 582.084019] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] ******************************************************************************** {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 582.084019] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] Configuration options gathered from: {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 582.084212] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 582.084212] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 582.084212] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] ================================================================================ {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 582.084212] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] agent_down_time = 75 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.084212] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] allow_automatic_dhcp_failover = True {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.084212] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] allow_bulk = True {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.084369] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] api_extensions_path = {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.084369] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] api_paste_config = api-paste.ini {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.084424] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] auth_strategy = keystone {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.084517] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] backdoor_port = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.084602] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] backdoor_socket = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.084745] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] backlog = 4096 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.084886] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] base_mac = fa:16:3e:00:00:00 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.085070] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] bind_host = 0.0.0.0 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.085221] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] bind_port = 9696 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.085360] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] client_socket_timeout = 900 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.085504] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] config_dir = [] {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.085618] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.085761] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] config_source = [] {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.085906] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] control_exchange = neutron {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.086084] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] core_plugin = ml2 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.086244] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] debug = True {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.086387] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] default_availability_zones = [] {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.086599] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.086746] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] dhcp_agent_notification = True {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.086889] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] dhcp_agents_per_network = 1 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.087060] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] dhcp_lease_duration = 86400 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.087226] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] dhcp_load_type = networks {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.087373] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] dns_domain = openstacklocal {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.087517] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.087655] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] enable_default_route_bfd = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.087790] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] enable_default_route_ecmp = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.087925] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] enable_dvr = True {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.088088] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] enable_new_agents = True {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.088226] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.088365] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] enable_signals = True {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.088498] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] enable_traditional_dhcp = True {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.088627] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] external_dns_driver = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.088760] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] filter_validation = True {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.088905] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] global_physnet_mtu = 8950 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.089053] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] graceful_shutdown_timeout = 60 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.089236] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] host = cpu-1 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.089381] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] host_dvr_for_dhcp = True {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.089528] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] http_retries = 3 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.089681] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] instance_format = [instance: %(uuid)s] {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.089825] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.089967] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] ipam_driver = internal {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.090114] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] ipv6_pd_enabled = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.090449] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] l3_ha = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.090449] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.090541] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] l3_ha_network_physical_name = {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.090663] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] l3_ha_network_type = {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.093020] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] log_color = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.093020] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] log_config_append = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.093020] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.093020] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] log_dir = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.093020] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] log_file = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.093020] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] log_options = True {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.093020] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] log_rotate_interval = 1 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.093267] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] log_rotate_interval_type = days {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.093267] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] log_rotation_type = none {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.093267] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.093267] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.093267] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.093420] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.093420] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.093420] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] max_dns_nameservers = 5 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.093420] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] max_header_line = 16384 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.093420] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] max_l3_agents_per_router = 3 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.093420] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] max_logfile_count = 30 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.093610] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] max_logfile_size_mb = 200 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.093610] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] max_subnet_host_routes = 20 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.093610] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] my_ip = 10.180.1.21 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.093695] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] my_ipv6 = ::1 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.093878] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] network_auto_schedule = True {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.093937] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] network_link_prefix = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.094127] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.094305] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] notify_nova_on_port_data_changes = True {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.094453] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] notify_nova_on_port_status_changes = True {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.094601] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] pagination_max_limit = -1 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.094737] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] publish_errors = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.094878] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] rate_limit_burst = 0 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.095032] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] rate_limit_except_level = CRITICAL {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.095177] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] rate_limit_interval = 0 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.095310] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] retry_until_window = 30 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.095447] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] router_distributed = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.095583] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] rpc_resources_processing_step = 20 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.095722] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] rpc_response_max_timeout = 600 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.095861] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] rpc_response_timeout = 60 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.096030] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] send_events_interval = 2 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.096189] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] service_plugins = ['router'] {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.096336] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] setproctitle = on {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.096472] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] shell_completion = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.096613] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] state_path = /opt/stack/data/neutron {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.096755] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] syslog_log_facility = LOG_USER {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.096894] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] tcp_keepidle = 600 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.097057] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] transport_url = **** {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.097201] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] use_journal = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.097338] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] use_json = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.097474] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] use_ssl = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.097609] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] use_stderr = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.097752] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] use_syslog = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.097888] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] vlan_qinq = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.098032] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] vlan_transparent = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.098171] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] watch_log_file = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.098621] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] wsgi_default_pool_size = 100 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.098621] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] wsgi_keep_alive = True {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.098621] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.098711] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] wsgi_server_debug = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.100566] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_concurrency.disable_process_locking = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.100566] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.100566] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.100566] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.100566] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.100566] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.100805] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.100805] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] profiler.connection_string = messaging:// {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.100805] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] profiler.enabled = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.100805] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] profiler.es_doc_type = notification {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.100805] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] profiler.es_scroll_size = 10000 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.100805] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] profiler.es_scroll_time = 2m {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.100805] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] profiler.filter_error_trace = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.101026] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] profiler.hmac_keys = **** {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.101026] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] profiler.sentinel_service_name = mymaster {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.101026] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] profiler.socket_timeout = 0.1 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.101149] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] profiler.trace_requests = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.101287] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] profiler.trace_sqlalchemy = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.101437] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] profiler_jaeger.process_tags = {} {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.101574] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] profiler_jaeger.service_name_prefix = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.101711] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] profiler_otlp.service_name_prefix = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.101862] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_policy.enforce_new_defaults = True {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.102147] env[69506]: WARNING oslo_config.cfg [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 582.102302] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_policy.enforce_scope = True {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.102451] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_policy.policy_default_rule = default {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.102604] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.102746] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.102891] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.103048] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.103188] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.103323] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.103462] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.103607] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_policy.remote_timeout = 60.0 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.103977] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.103977] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] agent.extensions = [] {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.104097] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.107024] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] service_providers.service_provider = [] {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.107024] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] QUOTAS.default_quota = -1 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.107024] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.107024] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] QUOTAS.quota_floatingip = 50 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.107024] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] QUOTAS.quota_network = 100 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.107024] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] QUOTAS.quota_port = 500 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.107024] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.107311] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] QUOTAS.quota_router = 10 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.107311] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] QUOTAS.quota_security_group = 10 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.107311] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.107311] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] QUOTAS.quota_subnet = 100 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.107311] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] QUOTAS.track_quota_usage = True {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.107311] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.107311] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] privsep.group = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.107522] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] privsep.helper_command = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.107522] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.107522] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] privsep.thread_pool_size = 8 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.107522] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] privsep.user = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.107522] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.107522] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] privsep_dhcp_release.group = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.107522] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] privsep_dhcp_release.helper_command = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.107732] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.107732] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.107732] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] privsep_dhcp_release.user = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.107732] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.107876] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] privsep_ovs_vsctl.group = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.108044] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] privsep_ovs_vsctl.helper_command = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.108201] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.108356] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.108498] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] privsep_ovs_vsctl.user = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.108646] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] privsep_namespace.capabilities = [21] {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.108784] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] privsep_namespace.group = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.108920] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] privsep_namespace.helper_command = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.109085] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.109234] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] privsep_namespace.thread_pool_size = 8 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.109400] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] privsep_namespace.user = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.109553] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] privsep_conntrack.capabilities = [12] {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.109693] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] privsep_conntrack.group = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.109829] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] privsep_conntrack.helper_command = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.109971] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.110125] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.110264] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] privsep_conntrack.user = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.110410] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] privsep_link.capabilities = [12, 21] {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.110545] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] privsep_link.group = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.110677] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] privsep_link.helper_command = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.110816] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.110954] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] privsep_link.thread_pool_size = 8 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.111100] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] privsep_link.user = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.111259] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.111408] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.111550] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] AGENT.continue_on_failed_promotions = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.111690] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] AGENT.dscp = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.111831] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] AGENT.dscp_inherit = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.111978] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] AGENT.force_mp_to_policy = True {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.112137] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] AGENT.locking_coordinator_url = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.112278] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] AGENT.log_agent_heartbeats = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.112420] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] AGENT.logging_expire = 1 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.112566] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.112708] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.112855] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] AGENT.polling_interval = 240 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.112998] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.113157] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.113301] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] AGENT.report_interval = 30.0 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.113445] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.113590] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.113734] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.113875] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] AGENT.sync_skew = 60 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.114077] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] AGENT.synchronization_queue_size = 20 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.114194] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] AGENT.use_helper_for_ns_read = True {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.114343] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] SECURITYGROUP.enable_ipset = True {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.114490] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] SECURITYGROUP.enable_security_group = True {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.114634] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.114779] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.114925] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] experimental.ipv6_pd_enabled = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.115106] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] ml2.extension_drivers = ['port_security'] {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.115248] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] ml2.external_network_type = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.115401] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.115549] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] ml2.overlay_ip_version = 4 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.115695] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] ml2.path_mtu = 8950 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.115839] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] ml2.physical_network_mtus = {} {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.115987] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] ml2.tenant_network_types = ['vlan'] {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.116178] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.116335] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] ml2.type_drivers = ['vlan'] {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.116485] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] AGENT_CLI.neutron_port_id = [] {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.116625] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.116765] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.116916] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.117079] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.118152] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.118152] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.118152] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.118152] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.118152] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.118152] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] NSXV3.nsxv3_login_password = **** {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.118401] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] NSXV3.nsxv3_login_port = 443 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.118401] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] NSXV3.nsxv3_login_user = admin {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.118469] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.118618] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.118764] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.118909] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.119083] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.119243] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.119395] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.119544] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.119691] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.119842] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.119995] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.120155] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.120308] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.120502] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.120656] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] vsphere.vsphere_login_password = VMware1! {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.120805] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.120949] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.121110] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] nova.auth_section = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.121302] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] nova.auth_type = password {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.121467] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.121611] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] nova.certfile = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.121763] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] nova.collect_timing = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.121920] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] nova.endpoint_type = public {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.122082] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] nova.insecure = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.122232] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] nova.keyfile = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.122388] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] nova.region_name = RegionOne {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.122539] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] nova.split_loggers = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.122684] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] nova.timeout = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.122834] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] placement.auth_section = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.122989] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] placement.auth_type = password {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.123151] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.123298] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] placement.certfile = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.123447] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] placement.collect_timing = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.123601] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] placement.endpoint_type = public {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.123746] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] placement.insecure = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.123888] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] placement.keyfile = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.124063] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] placement.region_name = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.124228] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] placement.split_loggers = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.124374] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] placement.timeout = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.124529] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] ironic.auth_section = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.124676] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] ironic.auth_type = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.124819] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] ironic.cafile = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.124961] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] ironic.certfile = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.125145] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] ironic.collect_timing = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.125297] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] ironic.connect_retries = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.125440] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] ironic.connect_retry_delay = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.125586] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] ironic.enable_notifications = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.125731] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] ironic.endpoint_override = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.125879] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] ironic.insecure = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.126120] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] ironic.interface = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.126287] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] ironic.keyfile = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.126433] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] ironic.max_version = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.126576] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] ironic.min_version = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.126719] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] ironic.region_name = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.126861] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] ironic.retriable_status_codes = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.127008] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] ironic.service_name = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.127174] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] ironic.service_type = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.127330] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] ironic.split_loggers = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.127473] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] ironic.status_code_retries = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.127615] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] ironic.status_code_retry_delay = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.127757] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] ironic.timeout = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.127899] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] ironic.valid_interfaces = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.128051] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] ironic.version = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.128207] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] cli_script.dry_run = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.128365] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.128508] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.128658] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.128802] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.128943] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.129099] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.129287] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.129442] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.129587] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.129738] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.129878] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.130038] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.130196] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.130344] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.130488] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.130636] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.130777] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.130920] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.131083] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.131231] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.131375] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.131524] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.131670] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.131814] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.131956] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.132110] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.132257] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.132405] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.132548] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.132691] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.132835] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_rabbit.ssl = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.132985] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.133148] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.133295] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.133448] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.133599] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_rabbit.ssl_version = {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.133746] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.133900] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_notifications.driver = [] {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.134075] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_notifications.retry = -1 {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.134257] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.134404] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] oslo_messaging_notifications.transport_url = **** {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.134521] env[69506]: DEBUG oslo_service.backend.eventlet.service [None req-3f715ece-cc01-4126-bf64-55f264780a50 None None] ******************************************************************************** {{(pid=69506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 582.135523] env[69506]: DEBUG neutron.agent.securitygroups_rpc [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Init firewall settings (driver=nsxv3) {{(pid=69506) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 582.136862] env[69506]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=69506) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 582.137146] env[69506]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] RPC agent_id: nsxm-l-01a.corp.local [ 582.139471] env[69506]: DEBUG dogpile.cache.region [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 582.139598] env[69506]: DEBUG dogpile.lock [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 582.139700] env[69506]: DEBUG dogpile.lock [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 582.139795] env[69506]: DEBUG dogpile.lock [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 582.139893] env[69506]: DEBUG dogpile.cache.region [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 582.139982] env[69506]: DEBUG dogpile.lock [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 582.140120] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 582.158047] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Session token - acquiring [ 582.159546] env[69506]: DEBUG networking_nsxv3.common.locking [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.159714] env[69506]: DEBUG oslo_concurrency.lockutils [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.159821] env[69506]: DEBUG oslo_concurrency.lockutils [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.160241] env[69506]: DEBUG oslo_concurrency.lockutils [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.170053] env[69506]: DEBUG oslo_concurrency.lockutils [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.427438] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 582.448493] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 582.448493] env[69506]: DEBUG dogpile.cache.region [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Cache value generated in 0.308 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 582.448493] env[69506]: DEBUG dogpile.lock [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 582.448493] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Activating Policy API Provider. [ 582.448720] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Looking for the default Infrastructure Rules. [ 582.509957] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Looking for the Default Layer3 Logged Drop Section. [ 582.523741] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 582.524203] env[69506]: DEBUG networking_nsxv3.common.locking [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.524377] env[69506]: DEBUG oslo_concurrency.lockutils [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Acquiring lock "all" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.524484] env[69506]: DEBUG oslo_concurrency.lockutils [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Acquired lock "all" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.524775] env[69506]: DEBUG oslo_concurrency.lockutils [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Acquired external semaphore "all" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.525124] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.040058] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.543384] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.045169] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Inventory metadata is going to be refreshed. [ 584.045347] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 584.819732] env[69506]: DEBUG networking_nsxv3.common.locking [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.820169] env[69506]: DEBUG oslo_concurrency.lockutils [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.820169] env[69506]: DEBUG oslo_concurrency.lockutils [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.820378] env[69506]: DEBUG oslo_concurrency.lockutils [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.940509] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 584.941442] env[69506]: DEBUG oslo_concurrency.lockutils [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.942433] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 584.958775] env[69506]: DEBUG networking_nsxv3.common.locking [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.959069] env[69506]: DEBUG oslo_concurrency.lockutils [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.959069] env[69506]: DEBUG oslo_concurrency.lockutils [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.959350] env[69506]: DEBUG oslo_concurrency.lockutils [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.959475] env[69506]: DEBUG oslo_concurrency.lockutils [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.959624] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 584.959739] env[69506]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=69506) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 584.959848] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 584.978775] env[69506]: DEBUG networking_nsxv3.common.locking [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.978979] env[69506]: DEBUG oslo_concurrency.lockutils [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.979061] env[69506]: DEBUG oslo_concurrency.lockutils [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.979363] env[69506]: DEBUG oslo_concurrency.lockutils [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.979538] env[69506]: DEBUG oslo_concurrency.lockutils [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.979685] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 584.998353] env[69506]: DEBUG networking_nsxv3.common.locking [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.998561] env[69506]: DEBUG oslo_concurrency.lockutils [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.998692] env[69506]: DEBUG oslo_concurrency.lockutils [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.998910] env[69506]: DEBUG oslo_concurrency.lockutils [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.999065] env[69506]: DEBUG oslo_concurrency.lockutils [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.999212] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 585.019197] env[69506]: DEBUG networking_nsxv3.common.locking [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.019467] env[69506]: DEBUG oslo_concurrency.lockutils [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Acquiring lock "Address Group" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.019467] env[69506]: DEBUG oslo_concurrency.lockutils [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Acquired lock "Address Group" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.019714] env[69506]: DEBUG oslo_concurrency.lockutils [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Acquired external semaphore "Address Group" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.019848] env[69506]: DEBUG oslo_concurrency.lockutils [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Releasing lock "Address Group" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.019992] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 585.020115] env[69506]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69506) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 585.020222] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 585.036128] env[69506]: DEBUG networking_nsxv3.common.locking [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.036359] env[69506]: DEBUG oslo_concurrency.lockutils [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Acquiring lock "Segment QoS" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.036443] env[69506]: DEBUG oslo_concurrency.lockutils [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Acquired lock "Segment QoS" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.036694] env[69506]: DEBUG oslo_concurrency.lockutils [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Acquired external semaphore "Segment QoS" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.036815] env[69506]: DEBUG oslo_concurrency.lockutils [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Releasing lock "Segment QoS" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.036955] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 585.037092] env[69506]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=69506) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 585.037211] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 585.054287] env[69506]: DEBUG networking_nsxv3.common.locking [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.054460] env[69506]: DEBUG oslo_concurrency.lockutils [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.054572] env[69506]: DEBUG oslo_concurrency.lockutils [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.054840] env[69506]: DEBUG oslo_concurrency.lockutils [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.054980] env[69506]: DEBUG oslo_concurrency.lockutils [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.055147] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 585.055256] env[69506]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69506) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 585.055359] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Inventory metadata have been refreshed. [ 585.055460] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Dryrun:True. Metadata refresh completed. [ 585.055581] env[69506]: DEBUG oslo_concurrency.lockutils [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Releasing lock "all" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.057511] env[69506]: INFO neutron.agent.agent_extensions_manager [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Loaded agent extensions: [] [ 585.058233] env[69506]: DEBUG neutron_lib.callbacks.manager [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=69506) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 585.124278] env[69506]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] NSXv3 Agent Agent RPC Daemon Started! [ 585.124454] env[69506]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] NSXv3 Agent Agent loop - iteration:0 started [ 585.124515] env[69506]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] NSXv3 Agent Agent out of sync with plugin! [ 590.059558] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 590.059931] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 595.062999] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 595.063369] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 599.005955] env[69506]: INFO networking_nsxv3.common.synchronization [None req-3b5ebe33-edb7-4a16-96bc-ce31956d97a2 demo admin] Enqueued Resource ID: 39f3c3c0-ea8f-4432-a9a7-f05801d0ec5e with Priority: HIGHEST for action security_group_rules [ 599.006228] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39f3c3c0-ea8f-4432-a9a7-f05801d0ec5e with Priority: HIGHEST for action security_group_rules [ 599.006795] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39f3c3c0-ea8f-4432-a9a7-f05801d0ec5e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.006919] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39f3c3c0-ea8f-4432-a9a7-f05801d0ec5e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.006986] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39f3c3c0-ea8f-4432-a9a7-f05801d0ec5e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.007376] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39f3c3c0-ea8f-4432-a9a7-f05801d0ec5e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.007522] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39f3c3c0-ea8f-4432-a9a7-f05801d0ec5e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.528467] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.528734] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.528734] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.528832] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.528931] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.529036] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39f3c3c0-ea8f-4432-a9a7-f05801d0ec5e already deleted. [ 599.529121] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39f3c3c0-ea8f-4432-a9a7-f05801d0ec5e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.008122] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 604.008484] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 609.009234] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 609.009234] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 614.010283] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 614.010700] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 619.012452] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 619.012452] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 621.062124] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.062124] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.062124] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.062124] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.062124] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.567424] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.070429] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.575797] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 622.576011] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 623.268025] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.268025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.268025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.268025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.277887] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 623.279190] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.280356] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 623.299094] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.299094] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.299094] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.299094] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.299094] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.299094] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 623.299094] env[69506]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69506) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 623.299094] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 623.319861] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.319861] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.319861] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.319861] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.319861] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.319861] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 623.340111] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.340111] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.340111] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.340111] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.340111] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.340111] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 623.359668] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.359668] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.359668] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.359668] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.359668] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.359668] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 623.359668] env[69506]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69506) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 623.359668] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 623.373978] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.374146] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.374201] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.374450] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.374586] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.374586] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 623.374700] env[69506]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69506) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 623.374921] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 623.394131] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.394344] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.394443] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.394744] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.394909] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.395107] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 623.395220] env[69506]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69506) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 623.395333] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 623.395439] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 623.395891] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 623.395891] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 623.395891] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 623.396186] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 623.396294] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 623.396405] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 623.414016] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.414368] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.414368] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.414691] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.414878] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.415018] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 623.431513] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.432637] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.432637] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.432637] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.432637] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.442914] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.012801] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 624.012908] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 627.043788] env[69506]: INFO networking_nsxv3.common.synchronization [None req-da25466c-d4c4-4837-ac57-8e28e7a3a4ff None None] Enqueued Resource ID: 621fbd18-ee05-4ba1-98f3-234164d349bb with Priority: HIGHEST for action port [ 627.043788] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 621fbd18-ee05-4ba1-98f3-234164d349bb with Priority: HIGHEST for action port [ 627.043788] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-621fbd18-ee05-4ba1-98f3-234164d349bb taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.043788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-621fbd18-ee05-4ba1-98f3-234164d349bb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.043788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-621fbd18-ee05-4ba1-98f3-234164d349bb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.043788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-621fbd18-ee05-4ba1-98f3-234164d349bb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.043788] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('621fbd18-ee05-4ba1-98f3-234164d349bb',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.549148] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 621fbd18-ee05-4ba1-98f3-234164d349bb [ 627.550948] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.550948] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.550948] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.550948] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.550948] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.550948] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:621fbd18-ee05-4ba1-98f3-234164d349bb already deleted. [ 627.550948] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-621fbd18-ee05-4ba1-98f3-234164d349bb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.916852] env[69506]: INFO networking_nsxv3.common.synchronization [None req-9317b15d-8937-4ed6-a98c-23661e16dab5 None None] Enqueued Resource ID: 365782af-cfae-41ee-b76f-731339f6c2f8 with Priority: HIGHEST for action port [ 628.918055] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 365782af-cfae-41ee-b76f-731339f6c2f8 with Priority: HIGHEST for action port [ 628.919788] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-365782af-cfae-41ee-b76f-731339f6c2f8 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.919788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-365782af-cfae-41ee-b76f-731339f6c2f8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.919788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-365782af-cfae-41ee-b76f-731339f6c2f8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.919788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-365782af-cfae-41ee-b76f-731339f6c2f8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.919788] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('365782af-cfae-41ee-b76f-731339f6c2f8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.958031] env[69506]: INFO networking_nsxv3.common.synchronization [None req-ff5af9d3-eae5-4385-a50a-b08731047448 None None] Enqueued Resource ID: e2d7d740-6499-4e1e-9c8a-492da6bdb472 with Priority: HIGHEST for action port [ 628.958031] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2d7d740-6499-4e1e-9c8a-492da6bdb472 with Priority: HIGHEST for action port [ 628.958031] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2d7d740-6499-4e1e-9c8a-492da6bdb472 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.958031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2d7d740-6499-4e1e-9c8a-492da6bdb472" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.958031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2d7d740-6499-4e1e-9c8a-492da6bdb472" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.958031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2d7d740-6499-4e1e-9c8a-492da6bdb472" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.958031] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2d7d740-6499-4e1e-9c8a-492da6bdb472',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.424910] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 365782af-cfae-41ee-b76f-731339f6c2f8 [ 629.424910] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.425271] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.425271] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.428086] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.428086] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.428086] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:365782af-cfae-41ee-b76f-731339f6c2f8 already deleted. [ 629.428086] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-365782af-cfae-41ee-b76f-731339f6c2f8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.460084] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e2d7d740-6499-4e1e-9c8a-492da6bdb472 [ 629.461211] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.461211] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.461211] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.461211] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.461211] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.461211] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e2d7d740-6499-4e1e-9c8a-492da6bdb472 already deleted. [ 629.461211] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2d7d740-6499-4e1e-9c8a-492da6bdb472" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.770050] env[69506]: INFO networking_nsxv3.common.synchronization [None req-0e5d3504-7e31-4988-b3ce-c374933b150f None None] Enqueued Resource ID: 85794c37-0da9-418b-bcf5-9eecbea3b03e with Priority: HIGHEST for action port [ 629.770050] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85794c37-0da9-418b-bcf5-9eecbea3b03e with Priority: HIGHEST for action port [ 629.770609] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-85794c37-0da9-418b-bcf5-9eecbea3b03e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.770868] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85794c37-0da9-418b-bcf5-9eecbea3b03e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.770868] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85794c37-0da9-418b-bcf5-9eecbea3b03e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.771681] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85794c37-0da9-418b-bcf5-9eecbea3b03e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.771807] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85794c37-0da9-418b-bcf5-9eecbea3b03e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.276143] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 85794c37-0da9-418b-bcf5-9eecbea3b03e [ 630.276376] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.276514] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.276584] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.276808] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.276907] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.277016] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:85794c37-0da9-418b-bcf5-9eecbea3b03e already deleted. [ 630.277097] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85794c37-0da9-418b-bcf5-9eecbea3b03e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.294855] env[69506]: INFO networking_nsxv3.common.synchronization [None req-4893635c-273b-4cd5-b140-59800b7d2458 None None] Enqueued Resource ID: 4a018857-a691-4f92-b265-874609731169 with Priority: HIGHEST for action port [ 630.295144] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a018857-a691-4f92-b265-874609731169 with Priority: HIGHEST for action port [ 630.295956] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a018857-a691-4f92-b265-874609731169 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.296102] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a018857-a691-4f92-b265-874609731169" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.298962] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a018857-a691-4f92-b265-874609731169" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.298962] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a018857-a691-4f92-b265-874609731169" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.298962] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a018857-a691-4f92-b265-874609731169',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.657268] env[69506]: INFO networking_nsxv3.common.synchronization [None req-4c4906ed-d574-43a9-b328-b4aeac11ad3d None None] Enqueued Resource ID: c77b8ea5-07a3-47c0-9be6-74c6fddfcd3f with Priority: HIGHEST for action port [ 630.657452] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c77b8ea5-07a3-47c0-9be6-74c6fddfcd3f with Priority: HIGHEST for action port [ 630.658163] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-c77b8ea5-07a3-47c0-9be6-74c6fddfcd3f taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.660819] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c77b8ea5-07a3-47c0-9be6-74c6fddfcd3f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.660819] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c77b8ea5-07a3-47c0-9be6-74c6fddfcd3f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.660920] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c77b8ea5-07a3-47c0-9be6-74c6fddfcd3f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.661025] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c77b8ea5-07a3-47c0-9be6-74c6fddfcd3f',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.801505] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4a018857-a691-4f92-b265-874609731169 [ 630.801792] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.802206] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.802206] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.802334] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.802334] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.802416] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4a018857-a691-4f92-b265-874609731169 already deleted. [ 630.803292] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a018857-a691-4f92-b265-874609731169" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.119292] env[69506]: INFO networking_nsxv3.common.synchronization [None req-93776cd8-6140-4c01-a143-0705f10d4f29 None None] Enqueued Resource ID: 0616e2bc-13ac-4651-a5f8-b8ac5a736828 with Priority: HIGHEST for action port [ 631.119944] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0616e2bc-13ac-4651-a5f8-b8ac5a736828 with Priority: HIGHEST for action port [ 631.120308] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-0616e2bc-13ac-4651-a5f8-b8ac5a736828 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.120438] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0616e2bc-13ac-4651-a5f8-b8ac5a736828" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.120508] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0616e2bc-13ac-4651-a5f8-b8ac5a736828" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.120761] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0616e2bc-13ac-4651-a5f8-b8ac5a736828" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.120850] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0616e2bc-13ac-4651-a5f8-b8ac5a736828',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.164698] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c77b8ea5-07a3-47c0-9be6-74c6fddfcd3f [ 631.164698] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.164698] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.164698] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.164698] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.164698] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.164698] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c77b8ea5-07a3-47c0-9be6-74c6fddfcd3f already deleted. [ 631.164698] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c77b8ea5-07a3-47c0-9be6-74c6fddfcd3f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.624399] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0616e2bc-13ac-4651-a5f8-b8ac5a736828 [ 631.624682] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.624760] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.624835] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.625285] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.625404] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.625504] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0616e2bc-13ac-4651-a5f8-b8ac5a736828 already deleted. [ 631.628121] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0616e2bc-13ac-4651-a5f8-b8ac5a736828" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.781341] env[69506]: INFO networking_nsxv3.common.synchronization [None req-35281f8c-3f7d-4fe4-8953-681f6bafcab2 None None] Enqueued Resource ID: 7b3be850-d234-4b57-ae2a-1ffcafb978b1 with Priority: HIGHEST for action port [ 631.781341] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b3be850-d234-4b57-ae2a-1ffcafb978b1 with Priority: HIGHEST for action port [ 631.781341] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b3be850-d234-4b57-ae2a-1ffcafb978b1 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.781341] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b3be850-d234-4b57-ae2a-1ffcafb978b1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.781341] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b3be850-d234-4b57-ae2a-1ffcafb978b1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.784836] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b3be850-d234-4b57-ae2a-1ffcafb978b1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.784836] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b3be850-d234-4b57-ae2a-1ffcafb978b1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.286324] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7b3be850-d234-4b57-ae2a-1ffcafb978b1 [ 632.286324] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.286324] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.286324] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.286324] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.286324] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.286324] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7b3be850-d234-4b57-ae2a-1ffcafb978b1 already deleted. [ 632.286324] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b3be850-d234-4b57-ae2a-1ffcafb978b1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.599351] env[69506]: INFO networking_nsxv3.common.synchronization [None req-00c43453-be15-433c-8a6b-0c075ac9630f None None] Enqueued Resource ID: b74749b2-996e-482b-b268-6aa53a0297a1 with Priority: HIGHEST for action port [ 632.599351] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b74749b2-996e-482b-b268-6aa53a0297a1 with Priority: HIGHEST for action port [ 632.599722] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-b74749b2-996e-482b-b268-6aa53a0297a1 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.599851] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b74749b2-996e-482b-b268-6aa53a0297a1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.599920] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b74749b2-996e-482b-b268-6aa53a0297a1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.600553] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b74749b2-996e-482b-b268-6aa53a0297a1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.600910] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b74749b2-996e-482b-b268-6aa53a0297a1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.106423] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b74749b2-996e-482b-b268-6aa53a0297a1 [ 633.106659] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.106802] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.106895] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.107161] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.108075] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.108075] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b74749b2-996e-482b-b268-6aa53a0297a1 already deleted. [ 633.108075] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b74749b2-996e-482b-b268-6aa53a0297a1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.456333] env[69506]: INFO networking_nsxv3.common.synchronization [None req-a3c46eb3-fd0c-4942-94ac-c84c7ffafa48 tempest-AttachInterfacesUnderV243Test-153413102 tempest-AttachInterfacesUnderV243Test-153413102-project-member] Enqueued Resource ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 with Priority: HIGHEST for action security_group_rules [ 633.456845] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 with Priority: HIGHEST for action security_group_rules [ 633.457173] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-74c7c33d-c19d-4ab6-af56-0941c2240118 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.457308] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.458418] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.458418] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.458418] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('74c7c33d-c19d-4ab6-af56-0941c2240118',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.593177] env[69506]: INFO networking_nsxv3.common.synchronization [None req-fd2fadda-348c-4ae4-8d6c-ed4251799951 tempest-AttachInterfacesUnderV243Test-153413102 tempest-AttachInterfacesUnderV243Test-153413102-project-member] Enqueued Resource ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 with Priority: HIGHEST for action security_group_rules [ 633.593177] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 with Priority: HIGHEST for action security_group_rules [ 633.593177] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-74c7c33d-c19d-4ab6-af56-0941c2240118 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.593177] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.761506] env[69506]: INFO networking_nsxv3.common.synchronization [None req-6fdac08b-a2a4-4aad-a92e-4d592cb15341 None None] Enqueued Resource ID: 73250466-2c91-4d0d-a974-b0757105fc2e with Priority: HIGHEST for action port [ 633.761913] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73250466-2c91-4d0d-a974-b0757105fc2e with Priority: HIGHEST for action port [ 633.762218] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-73250466-2c91-4d0d-a974-b0757105fc2e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.765054] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73250466-2c91-4d0d-a974-b0757105fc2e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.765054] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73250466-2c91-4d0d-a974-b0757105fc2e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.765320] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73250466-2c91-4d0d-a974-b0757105fc2e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.765554] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73250466-2c91-4d0d-a974-b0757105fc2e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.834064] env[69506]: INFO networking_nsxv3.common.synchronization [None req-a8077df5-b3fd-485b-8e85-4446a56bca21 None None] Enqueued Resource ID: 98115969-86c9-4d18-9836-61c1815d21c2 with Priority: HIGHEST for action port [ 633.834348] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98115969-86c9-4d18-9836-61c1815d21c2 with Priority: HIGHEST for action port [ 633.834894] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-98115969-86c9-4d18-9836-61c1815d21c2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.835054] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98115969-86c9-4d18-9836-61c1815d21c2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.835123] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98115969-86c9-4d18-9836-61c1815d21c2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.835394] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98115969-86c9-4d18-9836-61c1815d21c2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.835481] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98115969-86c9-4d18-9836-61c1815d21c2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.978928] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.979091] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.979162] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.979368] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.979456] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.979620] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 already deleted. [ 633.979620] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.980310] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.980310] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.980310] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('74c7c33d-c19d-4ab6-af56-0941c2240118',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.148898] env[69506]: INFO networking_nsxv3.common.synchronization [None req-981e9e69-a437-4697-839a-363e5ae49162 None None] Enqueued Resource ID: 94ec0c30-0425-4d54-af05-3ea7ae735f5d with Priority: HIGHEST for action port [ 634.149995] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94ec0c30-0425-4d54-af05-3ea7ae735f5d with Priority: HIGHEST for action port [ 634.149995] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-94ec0c30-0425-4d54-af05-3ea7ae735f5d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.150234] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94ec0c30-0425-4d54-af05-3ea7ae735f5d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.150234] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94ec0c30-0425-4d54-af05-3ea7ae735f5d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.150427] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94ec0c30-0425-4d54-af05-3ea7ae735f5d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.150510] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94ec0c30-0425-4d54-af05-3ea7ae735f5d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.267394] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 73250466-2c91-4d0d-a974-b0757105fc2e [ 634.267662] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.267952] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.267952] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.268192] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.268273] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.268365] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:73250466-2c91-4d0d-a974-b0757105fc2e already deleted. [ 634.268421] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73250466-2c91-4d0d-a974-b0757105fc2e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.341220] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 98115969-86c9-4d18-9836-61c1815d21c2 [ 634.341305] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.341482] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.341590] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.342241] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.342241] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.342241] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:98115969-86c9-4d18-9836-61c1815d21c2 already deleted. [ 634.342241] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98115969-86c9-4d18-9836-61c1815d21c2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.499515] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.499828] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.499828] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.499926] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.500028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.500123] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 already deleted. [ 634.500321] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.652146] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 94ec0c30-0425-4d54-af05-3ea7ae735f5d [ 634.652412] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.652548] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.652616] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.652835] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.652901] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.652992] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:94ec0c30-0425-4d54-af05-3ea7ae735f5d already deleted. [ 634.653085] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94ec0c30-0425-4d54-af05-3ea7ae735f5d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.253804] env[69506]: INFO networking_nsxv3.common.synchronization [None req-f01318e6-3aaf-4d88-ab18-410bb93d3d35 None None] Enqueued Resource ID: 59790f0c-81a1-492c-bcfb-0075706a4fb0 with Priority: HIGHEST for action port [ 636.254073] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59790f0c-81a1-492c-bcfb-0075706a4fb0 with Priority: HIGHEST for action port [ 636.254700] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-59790f0c-81a1-492c-bcfb-0075706a4fb0 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.254779] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59790f0c-81a1-492c-bcfb-0075706a4fb0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.254880] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59790f0c-81a1-492c-bcfb-0075706a4fb0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.255158] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59790f0c-81a1-492c-bcfb-0075706a4fb0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.255244] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59790f0c-81a1-492c-bcfb-0075706a4fb0',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.367426] env[69506]: INFO networking_nsxv3.common.synchronization [None req-a6b37f9e-8328-40df-ac39-81c60182ca16 None None] Enqueued Resource ID: 95dc19ca-9d97-4515-83d2-54a441dbaa52 with Priority: HIGHEST for action port [ 636.367602] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95dc19ca-9d97-4515-83d2-54a441dbaa52 with Priority: HIGHEST for action port [ 636.368979] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-95dc19ca-9d97-4515-83d2-54a441dbaa52 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.368979] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95dc19ca-9d97-4515-83d2-54a441dbaa52" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.368979] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95dc19ca-9d97-4515-83d2-54a441dbaa52" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.370415] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95dc19ca-9d97-4515-83d2-54a441dbaa52" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.370415] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95dc19ca-9d97-4515-83d2-54a441dbaa52',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.762422] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 59790f0c-81a1-492c-bcfb-0075706a4fb0 [ 636.762656] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.762793] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.762928] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.763140] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.763239] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.763339] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:59790f0c-81a1-492c-bcfb-0075706a4fb0 already deleted. [ 636.763422] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59790f0c-81a1-492c-bcfb-0075706a4fb0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.872413] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 95dc19ca-9d97-4515-83d2-54a441dbaa52 [ 636.873047] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.873047] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.873047] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.873240] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.873240] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.873299] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:95dc19ca-9d97-4515-83d2-54a441dbaa52 already deleted. [ 636.873394] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95dc19ca-9d97-4515-83d2-54a441dbaa52" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.176011] env[69506]: INFO networking_nsxv3.common.synchronization [req-518ef10f-5094-4908-a2f5-b3600e65e8bc req-3c4fe0a7-8a83-4e18-ad5a-30dbf00b2f6e tempest-TenantUsagesTestJSON-1481649972 tempest-TenantUsagesTestJSON-1481649972-project-member] Enqueued Resource ID: 9ce980c1-0c92-48ab-930f-2537a5f82269 with Priority: HIGHEST for action security_group_members [ 637.176594] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ce980c1-0c92-48ab-930f-2537a5f82269 with Priority: HIGHEST for action security_group_members [ 637.177221] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ce980c1-0c92-48ab-930f-2537a5f82269 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.177385] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ce980c1-0c92-48ab-930f-2537a5f82269" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.177476] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ce980c1-0c92-48ab-930f-2537a5f82269" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.177743] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ce980c1-0c92-48ab-930f-2537a5f82269" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.178248] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.178413] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.178506] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.178690] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.178806] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.179090] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ce980c1-0c92-48ab-930f-2537a5f82269',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.683851] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.683851] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.683851] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.683851] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.683851] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.683851] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.683851] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.683851] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.683851] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.683851] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.683851] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ce980c1-0c92-48ab-930f-2537a5f82269 already deleted. [ 637.683851] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ce980c1-0c92-48ab-930f-2537a5f82269" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.287581] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-438 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.287581] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.287581] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.288025] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.288417] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.288737] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.288957] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.289291] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.289530] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.289989] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 638.290303] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 638.290514] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 638.290708] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 638.290905] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 638.291124] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 638.291365] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 638.310279] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 638.311105] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 638.311105] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 638.311105] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.311105] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-c954d39e-02f4-4bf3-a43b-cb918bc7978c taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.311323] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-c954d39e-02f4-4bf3-a43b-cb918bc7978c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.311356] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-c954d39e-02f4-4bf3-a43b-cb918bc7978c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.311691] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-c954d39e-02f4-4bf3-a43b-cb918bc7978c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.311828] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c954d39e-02f4-4bf3-a43b-cb918bc7978c',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.359399] env[69506]: INFO networking_nsxv3.common.synchronization [None req-a1ef110a-fe0f-4d5f-9d8f-6a96f4ce2bb8 None None] Enqueued Resource ID: c4d5b089-d1b7-4a74-9621-d21c31c6be1f with Priority: HIGHEST for action port [ 638.359399] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4d5b089-d1b7-4a74-9621-d21c31c6be1f with Priority: HIGHEST for action port [ 638.359399] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4d5b089-d1b7-4a74-9621-d21c31c6be1f taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.359399] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4d5b089-d1b7-4a74-9621-d21c31c6be1f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.359724] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4d5b089-d1b7-4a74-9621-d21c31c6be1f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.360868] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4d5b089-d1b7-4a74-9621-d21c31c6be1f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.360868] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4d5b089-d1b7-4a74-9621-d21c31c6be1f',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.810455] env[69506]: INFO networking_nsxv3.common.synchronization [req-1a5c168a-70b7-4b93-8a04-160918cedf2d req-0a655d8a-d22a-4775-a4b7-6be5c9483850 tempest-DeleteServersAdminTestJSON-537793646 tempest-DeleteServersAdminTestJSON-537793646-project-member] Enqueued Resource ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 with Priority: HIGHEST for action security_group_members [ 638.811061] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 with Priority: HIGHEST for action security_group_members [ 638.811338] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.811472] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.811571] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.811782] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.811940] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.814470] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.814723] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.814723] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.814828] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.814872] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.816154] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.816363] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.816539] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.816721] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.817496] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.817496] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port c954d39e-02f4-4bf3-a43b-cb918bc7978c not found, creating... [ 638.817496] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.817496] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.817737] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.817778] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.818028] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.818304] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.818533] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.819125] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.819125] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.819125] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.819125] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: c954d39e-02f4-4bf3-a43b-cb918bc7978c is going to be created. [ 638.839143] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.839143] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.839143] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.839143] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.839356] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.839547] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-c954d39e-02f4-4bf3-a43b-cb918bc7978c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.863630] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c4d5b089-d1b7-4a74-9621-d21c31c6be1f [ 638.864042] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.864042] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.864171] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.864739] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.864739] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.864739] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c4d5b089-d1b7-4a74-9621-d21c31c6be1f already deleted. [ 638.864739] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4d5b089-d1b7-4a74-9621-d21c31c6be1f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.070234] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-438 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.070234] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.070234] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.070234] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.070564] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.070663] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.070756] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.070967] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.072377] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.072656] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 639.072782] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 639.072891] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 639.073000] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 639.074012] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 639.074498] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 639.074820] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 639.093314] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 639.093494] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 639.093637] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 639.093821] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.094157] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-40de5dab-8702-497b-95a9-4f1498193381 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.094778] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-40de5dab-8702-497b-95a9-4f1498193381" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.094778] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-40de5dab-8702-497b-95a9-4f1498193381" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.094778] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-40de5dab-8702-497b-95a9-4f1498193381" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.095014] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40de5dab-8702-497b-95a9-4f1498193381',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.320865] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.321065] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.321140] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.321351] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.321440] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.321634] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.321729] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.321789] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.321948] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.322043] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.322164] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 already deleted. [ 639.322238] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.598748] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.599361] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.599503] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.599744] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.599889] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.600055] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 40de5dab-8702-497b-95a9-4f1498193381 not found, creating... [ 639.600463] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.600559] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.600641] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.600878] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.601029] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.601325] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.601482] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.601665] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.602628] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.602628] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.603469] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 40de5dab-8702-497b-95a9-4f1498193381 is going to be created. [ 639.626892] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.626892] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.626892] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.626892] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.626892] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.626892] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-40de5dab-8702-497b-95a9-4f1498193381" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.732221] env[69506]: INFO networking_nsxv3.common.synchronization [req-518ef10f-5094-4908-a2f5-b3600e65e8bc req-6314de55-9467-4f3a-8ee4-84f7647fe5cc service nova] Enqueued Resource ID: 9ce980c1-0c92-48ab-930f-2537a5f82269 with Priority: HIGHEST for action security_group_rules [ 639.732221] env[69506]: INFO networking_nsxv3.common.synchronization [req-518ef10f-5094-4908-a2f5-b3600e65e8bc req-6314de55-9467-4f3a-8ee4-84f7647fe5cc service nova] Enqueued Resource ID: 9ce980c1-0c92-48ab-930f-2537a5f82269 with Priority: HIGHEST for action security_group_members [ 639.732524] env[69506]: INFO networking_nsxv3.common.synchronization [req-518ef10f-5094-4908-a2f5-b3600e65e8bc req-6314de55-9467-4f3a-8ee4-84f7647fe5cc service nova] Enqueued Resource ID: c954d39e-02f4-4bf3-a43b-cb918bc7978c with Priority: HIGHEST for action port [ 639.732795] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ce980c1-0c92-48ab-930f-2537a5f82269 with Priority: HIGHEST for action security_group_rules [ 639.732939] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ce980c1-0c92-48ab-930f-2537a5f82269 with Priority: HIGHEST for action security_group_members [ 639.734315] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c954d39e-02f4-4bf3-a43b-cb918bc7978c with Priority: HIGHEST for action port [ 639.734315] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ce980c1-0c92-48ab-930f-2537a5f82269 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.734315] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ce980c1-0c92-48ab-930f-2537a5f82269" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.734315] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ce980c1-0c92-48ab-930f-2537a5f82269" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.734591] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ce980c1-0c92-48ab-930f-2537a5f82269" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.734620] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ce980c1-0c92-48ab-930f-2537a5f82269',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.735490] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ce980c1-0c92-48ab-930f-2537a5f82269 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.735579] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ce980c1-0c92-48ab-930f-2537a5f82269" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.735650] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ce980c1-0c92-48ab-930f-2537a5f82269" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.735818] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ce980c1-0c92-48ab-930f-2537a5f82269" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.735962] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.736075] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.736277] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.736277] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.736356] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.736482] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ce980c1-0c92-48ab-930f-2537a5f82269',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.738479] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-c954d39e-02f4-4bf3-a43b-cb918bc7978c taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.738479] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c954d39e-02f4-4bf3-a43b-cb918bc7978c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.738672] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c954d39e-02f4-4bf3-a43b-cb918bc7978c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.738758] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c954d39e-02f4-4bf3-a43b-cb918bc7978c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.738839] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c954d39e-02f4-4bf3-a43b-cb918bc7978c',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.243124] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ce980c1-0c92-48ab-930f-2537a5f82269 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.243407] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ce980c1-0c92-48ab-930f-2537a5f82269" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.250692] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c954d39e-02f4-4bf3-a43b-cb918bc7978c with status ACTIVE [ 640.251204] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.251204] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.251204] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.251521] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.251521] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.251580] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.251668] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.251733] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.251930] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.251973] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.252215] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.252367] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.252367] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.252432] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.252500] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.252579] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c954d39e-02f4-4bf3-a43b-cb918bc7978c is going to be updated. [ 640.253748] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ce980c1-0c92-48ab-930f-2537a5f82269',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.273631] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.273772] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.274149] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.274149] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.275050] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.275050] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c954d39e-02f4-4bf3-a43b-cb918bc7978c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.590875] env[69506]: INFO networking_nsxv3.common.synchronization [req-1a5c168a-70b7-4b93-8a04-160918cedf2d req-59f386d2-bb29-4956-b8ff-e5e679cc1f93 service nova] Enqueued Resource ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 with Priority: HIGHEST for action security_group_rules [ 640.591745] env[69506]: INFO networking_nsxv3.common.synchronization [req-1a5c168a-70b7-4b93-8a04-160918cedf2d req-59f386d2-bb29-4956-b8ff-e5e679cc1f93 service nova] Enqueued Resource ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 with Priority: HIGHEST for action security_group_members [ 640.591745] env[69506]: INFO networking_nsxv3.common.synchronization [req-1a5c168a-70b7-4b93-8a04-160918cedf2d req-59f386d2-bb29-4956-b8ff-e5e679cc1f93 service nova] Enqueued Resource ID: 40de5dab-8702-497b-95a9-4f1498193381 with Priority: HIGHEST for action port [ 640.591859] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 with Priority: HIGHEST for action security_group_rules [ 640.591975] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 with Priority: HIGHEST for action security_group_members [ 640.592342] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40de5dab-8702-497b-95a9-4f1498193381 with Priority: HIGHEST for action port [ 640.592737] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.592949] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.593038] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.593279] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.593496] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.594327] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.595047] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.595047] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.595047] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.595047] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.595047] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.595047] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.595417] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.595417] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.595417] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.598481] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-40de5dab-8702-497b-95a9-4f1498193381 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.598481] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40de5dab-8702-497b-95a9-4f1498193381" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.598481] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40de5dab-8702-497b-95a9-4f1498193381" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.598481] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40de5dab-8702-497b-95a9-4f1498193381" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.598481] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40de5dab-8702-497b-95a9-4f1498193381',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.755731] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ce980c1-0c92-48ab-930f-2537a5f82269',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.101024] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.101024] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.101024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.101024] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 40de5dab-8702-497b-95a9-4f1498193381 with status ACTIVE [ 641.101024] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.101024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.101024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.101024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.101024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.101024] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.101024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.101024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.101024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.101024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.101637] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.101637] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.102383] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.102984] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.103116] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.103259] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 40de5dab-8702-497b-95a9-4f1498193381 is going to be updated. [ 641.123736] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.123871] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.123947] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.124199] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.124355] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.125121] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40de5dab-8702-497b-95a9-4f1498193381" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.261106] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.261106] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.261106] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.261106] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.261106] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.261106] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ce980c1-0c92-48ab-930f-2537a5f82269 is going to be created. [ 641.297931] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.297931] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.297931] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.297931] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.297931] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.305620] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ce980c1-0c92-48ab-930f-2537a5f82269 in Status: UNINITIALIZED for 2s [ 641.375400] env[69506]: INFO networking_nsxv3.common.synchronization [req-df2b1895-2f1b-4d80-891b-05d56380f688 req-f7a12793-4fa1-4be7-bce9-dabb0e9aca98 tempest-FloatingIPsAssociationNegativeTestJSON-1550362610 tempest-FloatingIPsAssociationNegativeTestJSON-1550362610-project-member] Enqueued Resource ID: c6cf0f63-443c-4fdc-9d02-4df041c1ea64 with Priority: HIGHEST for action security_group_members [ 641.375400] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6cf0f63-443c-4fdc-9d02-4df041c1ea64 with Priority: HIGHEST for action security_group_members [ 641.375400] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6cf0f63-443c-4fdc-9d02-4df041c1ea64 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.375400] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6cf0f63-443c-4fdc-9d02-4df041c1ea64" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.375400] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6cf0f63-443c-4fdc-9d02-4df041c1ea64" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.375400] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6cf0f63-443c-4fdc-9d02-4df041c1ea64" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.375400] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.375400] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.375400] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.375400] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.375400] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.375400] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6cf0f63-443c-4fdc-9d02-4df041c1ea64',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.576758] env[69506]: INFO networking_nsxv3.common.synchronization [None req-9038827e-ac1e-4de9-a968-35d021facaf6 None None] Enqueued Resource ID: ab186868-7c3e-4689-99d9-c9e200a82151 with Priority: HIGHEST for action port [ 641.576758] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab186868-7c3e-4689-99d9-c9e200a82151 with Priority: HIGHEST for action port [ 641.576758] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab186868-7c3e-4689-99d9-c9e200a82151 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.576758] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab186868-7c3e-4689-99d9-c9e200a82151" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.576758] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab186868-7c3e-4689-99d9-c9e200a82151" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.577372] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab186868-7c3e-4689-99d9-c9e200a82151" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.578027] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab186868-7c3e-4689-99d9-c9e200a82151',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.605548] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.879761] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.879905] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.879952] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.880267] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.880402] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.880711] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.880797] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.881038] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.881929] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.881929] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.881929] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6cf0f63-443c-4fdc-9d02-4df041c1ea64 already deleted. [ 641.881929] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6cf0f63-443c-4fdc-9d02-4df041c1ea64" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.080404] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ab186868-7c3e-4689-99d9-c9e200a82151 [ 642.081895] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.081895] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.081895] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.082060] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.082060] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.082179] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ab186868-7c3e-4689-99d9-c9e200a82151 already deleted. [ 642.083147] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab186868-7c3e-4689-99d9-c9e200a82151" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.111774] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.111774] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.111774] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.111774] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.111774] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.111774] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 is going to be created. [ 642.137286] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.139223] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.140375] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.140375] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.140375] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.149945] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 in Status: UNINITIALIZED for 2s [ 642.328827] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-808 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.330041] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-808" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.332018] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-808" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.332018] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-808" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.335282] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.335282] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.335282] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.335282] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.335282] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.335282] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 642.335282] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 642.335282] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 642.335282] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 642.335282] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 642.335282] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 642.335282] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 642.355878] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 642.356027] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 642.359845] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 642.359845] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-808" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.359845] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-27f9c7cb-0a43-465e-9c5d-1fa3e9e87a6a taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.359845] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-27f9c7cb-0a43-465e-9c5d-1fa3e9e87a6a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.359845] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-27f9c7cb-0a43-465e-9c5d-1fa3e9e87a6a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.360387] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-27f9c7cb-0a43-465e-9c5d-1fa3e9e87a6a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.360387] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27f9c7cb-0a43-465e-9c5d-1fa3e9e87a6a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.412825] env[69506]: INFO networking_nsxv3.common.synchronization [None req-a60f5f92-ad91-4972-ae3b-2f25aa0f1c6c None None] Enqueued Resource ID: 14a6d32f-f199-4bb4-b23d-6bd0cd49069b with Priority: HIGHEST for action port [ 642.414629] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14a6d32f-f199-4bb4-b23d-6bd0cd49069b with Priority: HIGHEST for action port [ 642.414969] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-14a6d32f-f199-4bb4-b23d-6bd0cd49069b taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.415495] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14a6d32f-f199-4bb4-b23d-6bd0cd49069b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.415575] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14a6d32f-f199-4bb4-b23d-6bd0cd49069b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.415823] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14a6d32f-f199-4bb4-b23d-6bd0cd49069b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.415925] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14a6d32f-f199-4bb4-b23d-6bd0cd49069b',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.747152] env[69506]: INFO networking_nsxv3.common.synchronization [None req-d8c7e6e9-99b6-4e7a-9642-a8e866e285d9 None None] Enqueued Resource ID: b42edefb-5d84-4944-8436-ec52509370e6 with Priority: HIGHEST for action port [ 642.747152] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b42edefb-5d84-4944-8436-ec52509370e6 with Priority: HIGHEST for action port [ 642.747152] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-b42edefb-5d84-4944-8436-ec52509370e6 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.747152] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b42edefb-5d84-4944-8436-ec52509370e6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.747152] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b42edefb-5d84-4944-8436-ec52509370e6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.748837] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b42edefb-5d84-4944-8436-ec52509370e6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.748953] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b42edefb-5d84-4944-8436-ec52509370e6',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.866115] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.866115] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.866115] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.866115] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.866115] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.866115] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 27f9c7cb-0a43-465e-9c5d-1fa3e9e87a6a not found, creating... [ 642.866115] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.866115] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.866115] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.866115] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.866115] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.866873] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.866873] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.869827] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.871062] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.871344] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.872235] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 27f9c7cb-0a43-465e-9c5d-1fa3e9e87a6a is going to be created. [ 642.890779] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.891318] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.891576] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.891930] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.892268] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.892662] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-27f9c7cb-0a43-465e-9c5d-1fa3e9e87a6a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.919045] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 14a6d32f-f199-4bb4-b23d-6bd0cd49069b [ 642.919685] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.919685] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.919685] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.919685] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.919685] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.919685] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:14a6d32f-f199-4bb4-b23d-6bd0cd49069b already deleted. [ 642.919942] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14a6d32f-f199-4bb4-b23d-6bd0cd49069b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.251272] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b42edefb-5d84-4944-8436-ec52509370e6 [ 643.251509] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.251646] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.251738] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.251921] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.252020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.252125] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b42edefb-5d84-4944-8436-ec52509370e6 already deleted. [ 643.252224] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b42edefb-5d84-4944-8436-ec52509370e6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.316723] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ce980c1-0c92-48ab-930f-2537a5f82269 in Status: SUCCESS [ 643.317071] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ce980c1-0c92-48ab-930f-2537a5f82269" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.317268] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ce980c1-0c92-48ab-930f-2537a5f82269" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.317458] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ce980c1-0c92-48ab-930f-2537a5f82269" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.317651] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.317776] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.318017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.318017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.318121] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.320324] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ce980c1-0c92-48ab-930f-2537a5f82269" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.320324] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ce980c1-0c92-48ab-930f-2537a5f82269',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.523143] env[69506]: INFO networking_nsxv3.common.synchronization [None req-3cfac51f-1f4f-4d1c-90ec-311fe2be0119 tempest-VolumesAssistedSnapshotsTest-664082795 tempest-VolumesAssistedSnapshotsTest-664082795-project-member] Enqueued Resource ID: 66b9350a-2732-4479-ad5a-cb47a49072f7 with Priority: HIGHEST for action security_group_rules [ 643.523143] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66b9350a-2732-4479-ad5a-cb47a49072f7 with Priority: HIGHEST for action security_group_rules [ 643.523575] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66b9350a-2732-4479-ad5a-cb47a49072f7 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.523802] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66b9350a-2732-4479-ad5a-cb47a49072f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.523874] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66b9350a-2732-4479-ad5a-cb47a49072f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.524316] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66b9350a-2732-4479-ad5a-cb47a49072f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.524466] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66b9350a-2732-4479-ad5a-cb47a49072f7',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.726288] env[69506]: INFO networking_nsxv3.common.synchronization [None req-00f75007-ace3-4470-886d-90caaa4870f6 tempest-VolumesAssistedSnapshotsTest-664082795 tempest-VolumesAssistedSnapshotsTest-664082795-project-member] Enqueued Resource ID: 66b9350a-2732-4479-ad5a-cb47a49072f7 with Priority: HIGHEST for action security_group_rules [ 643.726288] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66b9350a-2732-4479-ad5a-cb47a49072f7 with Priority: HIGHEST for action security_group_rules [ 643.726288] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66b9350a-2732-4479-ad5a-cb47a49072f7 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.726288] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66b9350a-2732-4479-ad5a-cb47a49072f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.821706] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ce980c1-0c92-48ab-930f-2537a5f82269 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.821812] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ce980c1-0c92-48ab-930f-2537a5f82269" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.822184] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ce980c1-0c92-48ab-930f-2537a5f82269" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.822184] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ce980c1-0c92-48ab-930f-2537a5f82269" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.822422] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.822422] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.822545] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.822591] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.822657] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.822772] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ce980c1-0c92-48ab-930f-2537a5f82269" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.823312] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ce980c1-0c92-48ab-930f-2537a5f82269 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.823312] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ce980c1-0c92-48ab-930f-2537a5f82269" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.823312] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ce980c1-0c92-48ab-930f-2537a5f82269" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.823312] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ce980c1-0c92-48ab-930f-2537a5f82269" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.823312] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.823775] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.823775] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.823775] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.823775] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.823775] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ce980c1-0c92-48ab-930f-2537a5f82269" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.824012] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ce980c1-0c92-48ab-930f-2537a5f82269',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.045097] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.045240] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.045289] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.045522] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.045623] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.046714] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66b9350a-2732-4479-ad5a-cb47a49072f7 already deleted. [ 644.046714] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66b9350a-2732-4479-ad5a-cb47a49072f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.046714] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66b9350a-2732-4479-ad5a-cb47a49072f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.046714] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66b9350a-2732-4479-ad5a-cb47a49072f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.046714] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66b9350a-2732-4479-ad5a-cb47a49072f7',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.075231] env[69506]: INFO networking_nsxv3.common.synchronization [None req-8147dcf4-6f35-4774-999c-09f5d89b6d79 None None] Enqueued Resource ID: 4992aa4a-43e6-4191-b9f6-c35238bc923e with Priority: HIGHEST for action port [ 644.075898] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4992aa4a-43e6-4191-b9f6-c35238bc923e with Priority: HIGHEST for action port [ 644.076279] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-4992aa4a-43e6-4191-b9f6-c35238bc923e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.076456] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4992aa4a-43e6-4191-b9f6-c35238bc923e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.076544] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4992aa4a-43e6-4191-b9f6-c35238bc923e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.076813] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4992aa4a-43e6-4191-b9f6-c35238bc923e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.076917] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4992aa4a-43e6-4191-b9f6-c35238bc923e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.158068] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 in Status: SUCCESS [ 644.158473] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.158473] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.158823] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.159120] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.159120] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.159120] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.159320] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.159320] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.159933] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.159933] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.329305] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ce980c1-0c92-48ab-930f-2537a5f82269: rpc.has_security_group_logging(os_id): False [ 644.351141] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.351141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.351141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.351141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.351141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.351141] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.351141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.351141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.351141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.351141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.351604] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.351604] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.351604] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.351604] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.351604] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.351957] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.351957] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.353342] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.353553] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.353643] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.353728] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ce980c1-0c92-48ab-930f-2537a5f82269 is going to be created. [ 644.372171] env[69506]: INFO networking_nsxv3.common.synchronization [req-cc8b645d-8b56-4c8b-9138-31e0fbd7c80c req-c2d9fa22-5cb0-420e-bdb8-be7340cb21a1 tempest-ServerDiskConfigTestJSON-583020681 tempest-ServerDiskConfigTestJSON-583020681-project-member] Enqueued Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_members [ 644.374873] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_members [ 644.374873] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-008501d4-938b-4336-9c1d-ef3665f7d09d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.374873] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.374873] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.374873] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.374873] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.374873] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.374873] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.374873] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.374873] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.379823] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.413404] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.413599] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.413694] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.414454] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.414705] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.425594] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ce980c1-0c92-48ab-930f-2537a5f82269 in Status: IN_PROGRESS for 2s [ 644.576656] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.576656] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.576656] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.576656] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.576656] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.576656] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66b9350a-2732-4479-ad5a-cb47a49072f7 already deleted. [ 644.576656] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66b9350a-2732-4479-ad5a-cb47a49072f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.580311] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4992aa4a-43e6-4191-b9f6-c35238bc923e [ 644.580718] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.580718] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.580925] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.580981] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.581650] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.581650] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4992aa4a-43e6-4191-b9f6-c35238bc923e already deleted. [ 644.581650] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4992aa4a-43e6-4191-b9f6-c35238bc923e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.663062] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.663348] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.663443] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.663733] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.664187] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.664187] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.664187] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.664351] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.664351] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.664452] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.664592] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.664825] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.664825] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.665255] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.665255] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.665255] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.665255] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.665426] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.665615] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.665615] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.665713] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.884546] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.884729] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.884791] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.885020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.885123] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.885365] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.885517] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.885517] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.885658] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.885764] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.885868] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 008501d4-938b-4336-9c1d-ef3665f7d09d already deleted. [ 644.885952] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.070691] env[69506]: INFO networking_nsxv3.common.synchronization [req-df2b1895-2f1b-4d80-891b-05d56380f688 req-bae8cd20-9b85-43ba-9ebb-28a09c713bb0 service nova] Enqueued Resource ID: c6cf0f63-443c-4fdc-9d02-4df041c1ea64 with Priority: HIGHEST for action security_group_rules [ 645.071287] env[69506]: INFO networking_nsxv3.common.synchronization [req-df2b1895-2f1b-4d80-891b-05d56380f688 req-bae8cd20-9b85-43ba-9ebb-28a09c713bb0 service nova] Enqueued Resource ID: c6cf0f63-443c-4fdc-9d02-4df041c1ea64 with Priority: HIGHEST for action security_group_members [ 645.071287] env[69506]: INFO networking_nsxv3.common.synchronization [req-df2b1895-2f1b-4d80-891b-05d56380f688 req-bae8cd20-9b85-43ba-9ebb-28a09c713bb0 service nova] Enqueued Resource ID: 27f9c7cb-0a43-465e-9c5d-1fa3e9e87a6a with Priority: HIGHEST for action port [ 645.072301] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6cf0f63-443c-4fdc-9d02-4df041c1ea64 with Priority: HIGHEST for action security_group_rules [ 645.072711] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6cf0f63-443c-4fdc-9d02-4df041c1ea64 with Priority: HIGHEST for action security_group_members [ 645.072883] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27f9c7cb-0a43-465e-9c5d-1fa3e9e87a6a with Priority: HIGHEST for action port [ 645.073368] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6cf0f63-443c-4fdc-9d02-4df041c1ea64 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.073368] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6cf0f63-443c-4fdc-9d02-4df041c1ea64" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.073492] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6cf0f63-443c-4fdc-9d02-4df041c1ea64" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.075970] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6cf0f63-443c-4fdc-9d02-4df041c1ea64" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.075970] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6cf0f63-443c-4fdc-9d02-4df041c1ea64',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.075970] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6cf0f63-443c-4fdc-9d02-4df041c1ea64 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.075970] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6cf0f63-443c-4fdc-9d02-4df041c1ea64" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.076563] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6cf0f63-443c-4fdc-9d02-4df041c1ea64" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.076888] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6cf0f63-443c-4fdc-9d02-4df041c1ea64" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.077370] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.077370] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.077482] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.077655] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.077774] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.077893] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6cf0f63-443c-4fdc-9d02-4df041c1ea64',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.079057] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-27f9c7cb-0a43-465e-9c5d-1fa3e9e87a6a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.079213] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27f9c7cb-0a43-465e-9c5d-1fa3e9e87a6a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.083094] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27f9c7cb-0a43-465e-9c5d-1fa3e9e87a6a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.083434] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27f9c7cb-0a43-465e-9c5d-1fa3e9e87a6a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.083434] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27f9c7cb-0a43-465e-9c5d-1fa3e9e87a6a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.171844] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5: rpc.has_security_group_logging(os_id): False [ 645.200260] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.200767] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.200767] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.200982] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.201113] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.201562] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.201562] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.201663] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.201948] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.201948] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.202118] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.202118] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.202244] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.202318] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.202362] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.202544] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.202633] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.202691] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.202827] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.202901] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.202969] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 is going to be created. [ 645.265037] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.265037] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.265037] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.265037] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.265037] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.274783] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 in Status: IN_PROGRESS for 2s [ 645.589367] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6cf0f63-443c-4fdc-9d02-4df041c1ea64 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.589367] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6cf0f63-443c-4fdc-9d02-4df041c1ea64" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.589367] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c6cf0f63-443c-4fdc-9d02-4df041c1ea64',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.589367] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 27f9c7cb-0a43-465e-9c5d-1fa3e9e87a6a with status ACTIVE [ 645.589367] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.589367] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.589367] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.589367] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.589367] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.589367] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.589367] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.589367] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.589367] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.589367] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.590239] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.590239] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.590239] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.590239] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.590239] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.590239] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 27f9c7cb-0a43-465e-9c5d-1fa3e9e87a6a is going to be updated. [ 645.613790] env[69506]: INFO networking_nsxv3.common.synchronization [None req-eddefe95-f2ba-42da-aa39-2be950b65396 None None] Enqueued Resource ID: b3a6d667-81b5-4a61-86a9-e82f2b1bbf0b with Priority: HIGHEST for action port [ 645.616593] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.617377] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.617524] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.617850] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.618070] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.618324] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27f9c7cb-0a43-465e-9c5d-1fa3e9e87a6a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.618983] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3a6d667-81b5-4a61-86a9-e82f2b1bbf0b with Priority: HIGHEST for action port [ 645.619447] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3a6d667-81b5-4a61-86a9-e82f2b1bbf0b taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.619640] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3a6d667-81b5-4a61-86a9-e82f2b1bbf0b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.619813] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3a6d667-81b5-4a61-86a9-e82f2b1bbf0b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.620178] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3a6d667-81b5-4a61-86a9-e82f2b1bbf0b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.620299] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3a6d667-81b5-4a61-86a9-e82f2b1bbf0b',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.913033] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-350 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.913228] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-350" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.913373] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-350" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.913662] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-350" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.913917] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.914140] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.914230] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.914413] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.914549] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.914748] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 645.914855] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 645.914975] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 645.915068] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 645.915171] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 645.915271] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 645.916998] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 645.941488] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 645.941684] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 645.941806] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 645.942175] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-350" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.942380] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-b43bd28d-5ebe-4bc9-9633-8ce0072566b1 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.942571] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-b43bd28d-5ebe-4bc9-9633-8ce0072566b1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.943284] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-b43bd28d-5ebe-4bc9-9633-8ce0072566b1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.943284] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-b43bd28d-5ebe-4bc9-9633-8ce0072566b1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.943284] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b43bd28d-5ebe-4bc9-9633-8ce0072566b1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.094479] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c6cf0f63-443c-4fdc-9d02-4df041c1ea64',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.123966] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b3a6d667-81b5-4a61-86a9-e82f2b1bbf0b [ 646.123966] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.123966] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.123966] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.124438] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.124578] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.124709] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b3a6d667-81b5-4a61-86a9-e82f2b1bbf0b already deleted. [ 646.124753] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3a6d667-81b5-4a61-86a9-e82f2b1bbf0b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.233354] env[69506]: INFO networking_nsxv3.common.synchronization [None req-d0c51e8e-842d-4238-b135-99e0a5a94fe7 None None] Enqueued Resource ID: 55591cb7-cd43-4229-912b-ed91b11bf5ca with Priority: HIGHEST for action port [ 646.234345] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55591cb7-cd43-4229-912b-ed91b11bf5ca with Priority: HIGHEST for action port [ 646.234345] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-55591cb7-cd43-4229-912b-ed91b11bf5ca taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.234345] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55591cb7-cd43-4229-912b-ed91b11bf5ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.236848] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55591cb7-cd43-4229-912b-ed91b11bf5ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.236848] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55591cb7-cd43-4229-912b-ed91b11bf5ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.236848] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55591cb7-cd43-4229-912b-ed91b11bf5ca',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.438044] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ce980c1-0c92-48ab-930f-2537a5f82269 in Status: SUCCESS [ 646.438525] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ce980c1-0c92-48ab-930f-2537a5f82269" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.445285] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.449139] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.449139] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.449139] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.449139] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.449139] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port b43bd28d-5ebe-4bc9-9633-8ce0072566b1 not found, creating... [ 646.449139] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.449139] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.449139] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.449139] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.449139] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.449940] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.449940] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.449940] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.449940] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.449940] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.449940] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: b43bd28d-5ebe-4bc9-9633-8ce0072566b1 is going to be created. [ 646.468113] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.470017] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.470017] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.470017] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.470326] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.470658] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-b43bd28d-5ebe-4bc9-9633-8ce0072566b1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.599563] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.599563] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.599563] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.599563] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.599563] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.599563] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6cf0f63-443c-4fdc-9d02-4df041c1ea64 is going to be created. [ 646.627270] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.627817] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.627817] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.627817] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.627817] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.640009] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6cf0f63-443c-4fdc-9d02-4df041c1ea64 in Status: UNINITIALIZED for 2s [ 646.739189] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 55591cb7-cd43-4229-912b-ed91b11bf5ca [ 646.739189] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.739321] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.739386] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.739616] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.739779] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.739812] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:55591cb7-cd43-4229-912b-ed91b11bf5ca already deleted. [ 646.739886] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55591cb7-cd43-4229-912b-ed91b11bf5ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.773111] env[69506]: INFO networking_nsxv3.common.synchronization [req-6891ea95-a4a8-4b68-93ca-1ba3b3f935ff req-8669f2eb-2ca5-4f8b-9e3b-c1b8fb76d78c tempest-MigrationsAdminTest-625008670 tempest-MigrationsAdminTest-625008670-project-member] Enqueued Resource ID: 0745f36a-3469-4c49-9c0f-8111fe1bd802 with Priority: HIGHEST for action security_group_members [ 646.773590] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0745f36a-3469-4c49-9c0f-8111fe1bd802 with Priority: HIGHEST for action security_group_members [ 646.773889] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0745f36a-3469-4c49-9c0f-8111fe1bd802 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.774039] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.774087] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.774330] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.776738] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.776738] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.776738] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.776738] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.776738] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.776738] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0745f36a-3469-4c49-9c0f-8111fe1bd802',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.279993] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.280206] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.280297] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.280715] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.280715] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.280914] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.281053] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.281192] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.281385] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.281484] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.281586] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0745f36a-3469-4c49-9c0f-8111fe1bd802 already deleted. [ 647.281960] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.289594] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 in Status: SUCCESS [ 647.289594] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.454770] env[69506]: INFO networking_nsxv3.common.synchronization [None req-ca83dce5-e9b6-4a6a-b5ed-2185a3a0ecd3 None None] Enqueued Resource ID: bc107505-b10b-4dde-9f80-c5deb9c25540 with Priority: HIGHEST for action port [ 647.455410] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc107505-b10b-4dde-9f80-c5deb9c25540 with Priority: HIGHEST for action port [ 647.456504] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc107505-b10b-4dde-9f80-c5deb9c25540 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.456504] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc107505-b10b-4dde-9f80-c5deb9c25540" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.460620] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc107505-b10b-4dde-9f80-c5deb9c25540" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.460620] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc107505-b10b-4dde-9f80-c5deb9c25540" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.460620] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc107505-b10b-4dde-9f80-c5deb9c25540',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.580493] env[69506]: INFO networking_nsxv3.common.synchronization [None req-17396ebe-8e00-4efe-b7db-9d471fdb05c1 tempest-ServersWithSpecificFlavorTestJSON-989278643 tempest-ServersWithSpecificFlavorTestJSON-989278643-project-member] Enqueued Resource ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 with Priority: HIGHEST for action security_group_rules [ 647.582307] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 with Priority: HIGHEST for action security_group_rules [ 647.583074] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6908af9-f839-40b2-9ca2-1fd554ee1d78 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.583074] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.585450] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.585450] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.585450] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6908af9-f839-40b2-9ca2-1fd554ee1d78',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.962489] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bc107505-b10b-4dde-9f80-c5deb9c25540 [ 647.962830] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.962915] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.962963] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.963206] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.963304] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.963402] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bc107505-b10b-4dde-9f80-c5deb9c25540 already deleted. [ 647.963491] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc107505-b10b-4dde-9f80-c5deb9c25540" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.107054] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.107194] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.107273] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.107733] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.107733] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.107733] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 already deleted. [ 648.107934] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.192563] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-438 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.193023] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.193108] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.194491] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.194491] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.194664] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.194785] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.195090] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.195319] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.195534] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 648.195651] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 648.195762] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 648.195873] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 648.195984] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 648.196112] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 648.196253] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 648.215660] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 648.215897] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 648.216160] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 648.216865] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.216865] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-23330338-bd2d-4050-a412-bba2d9a797bf taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.216865] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-23330338-bd2d-4050-a412-bba2d9a797bf" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.217086] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-23330338-bd2d-4050-a412-bba2d9a797bf" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.218678] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-23330338-bd2d-4050-a412-bba2d9a797bf" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.218678] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23330338-bd2d-4050-a412-bba2d9a797bf',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.249978] env[69506]: INFO networking_nsxv3.common.synchronization [None req-5b1cb5b9-7222-497a-8b1c-a1683f03d3bf tempest-ServersWithSpecificFlavorTestJSON-989278643 tempest-ServersWithSpecificFlavorTestJSON-989278643-project-member] Enqueued Resource ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 with Priority: HIGHEST for action security_group_rules [ 648.251784] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 with Priority: HIGHEST for action security_group_rules [ 648.251784] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6908af9-f839-40b2-9ca2-1fd554ee1d78 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.251784] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.251784] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.252639] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.252639] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6908af9-f839-40b2-9ca2-1fd554ee1d78',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.276193] env[69506]: INFO networking_nsxv3.common.synchronization [None req-fafc957f-977f-4cf3-ae4b-27511606ba09 None None] Enqueued Resource ID: 087d382f-2d93-4198-b9f1-b36352de1247 with Priority: HIGHEST for action port [ 648.276272] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 087d382f-2d93-4198-b9f1-b36352de1247 with Priority: HIGHEST for action port [ 648.276592] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-087d382f-2d93-4198-b9f1-b36352de1247 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.276853] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-087d382f-2d93-4198-b9f1-b36352de1247" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.276853] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-087d382f-2d93-4198-b9f1-b36352de1247" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.277519] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-087d382f-2d93-4198-b9f1-b36352de1247" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.278751] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('087d382f-2d93-4198-b9f1-b36352de1247',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.650672] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6cf0f63-443c-4fdc-9d02-4df041c1ea64 in Status: SUCCESS [ 648.650755] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6cf0f63-443c-4fdc-9d02-4df041c1ea64" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.650934] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6cf0f63-443c-4fdc-9d02-4df041c1ea64" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.651169] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6cf0f63-443c-4fdc-9d02-4df041c1ea64" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.651418] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.651880] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.652201] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.652426] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.652511] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.652606] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6cf0f63-443c-4fdc-9d02-4df041c1ea64" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.652697] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c6cf0f63-443c-4fdc-9d02-4df041c1ea64',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.681911] env[69506]: INFO networking_nsxv3.common.synchronization [None req-ca1dc84d-7d28-47cd-b887-fdbb77feced6 None None] Enqueued Resource ID: 3e22dbe2-aa58-4758-a0a2-f2b363fb399a with Priority: HIGHEST for action port [ 648.682508] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e22dbe2-aa58-4758-a0a2-f2b363fb399a with Priority: HIGHEST for action port [ 648.682822] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e22dbe2-aa58-4758-a0a2-f2b363fb399a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.682944] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e22dbe2-aa58-4758-a0a2-f2b363fb399a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.683271] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e22dbe2-aa58-4758-a0a2-f2b363fb399a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.684366] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e22dbe2-aa58-4758-a0a2-f2b363fb399a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.684366] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e22dbe2-aa58-4758-a0a2-f2b363fb399a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.725939] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.725939] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.725939] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.725939] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.725939] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.725939] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 23330338-bd2d-4050-a412-bba2d9a797bf not found, creating... [ 648.726216] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.726367] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.726431] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.727297] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.727297] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.727297] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.727481] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.727713] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.728278] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.728278] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.728400] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 23330338-bd2d-4050-a412-bba2d9a797bf is going to be created. [ 648.751422] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.751592] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.751630] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.752080] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.752241] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.752355] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-23330338-bd2d-4050-a412-bba2d9a797bf" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.771404] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.773285] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.773285] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.773285] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.773285] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.773285] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 already deleted. [ 648.773285] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.782680] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 087d382f-2d93-4198-b9f1-b36352de1247 [ 648.782680] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.782680] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.782680] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.782680] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.782680] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.782680] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:087d382f-2d93-4198-b9f1-b36352de1247 already deleted. [ 648.782680] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-087d382f-2d93-4198-b9f1-b36352de1247" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.874636] env[69506]: INFO networking_nsxv3.common.synchronization [req-cc8b645d-8b56-4c8b-9138-31e0fbd7c80c req-c209d263-96b0-43bf-b9f0-a0d6d78ffa92 service nova] Enqueued Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_rules [ 648.874636] env[69506]: INFO networking_nsxv3.common.synchronization [req-cc8b645d-8b56-4c8b-9138-31e0fbd7c80c req-c209d263-96b0-43bf-b9f0-a0d6d78ffa92 service nova] Enqueued Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_members [ 648.875286] env[69506]: INFO networking_nsxv3.common.synchronization [req-cc8b645d-8b56-4c8b-9138-31e0fbd7c80c req-c209d263-96b0-43bf-b9f0-a0d6d78ffa92 service nova] Enqueued Resource ID: b43bd28d-5ebe-4bc9-9633-8ce0072566b1 with Priority: HIGHEST for action port [ 648.875817] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_rules [ 648.875817] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_members [ 648.875976] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b43bd28d-5ebe-4bc9-9633-8ce0072566b1 with Priority: HIGHEST for action port [ 648.876584] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-008501d4-938b-4336-9c1d-ef3665f7d09d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.876684] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.876765] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.878168] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.878272] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.879309] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-008501d4-938b-4336-9c1d-ef3665f7d09d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.879816] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.879816] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.879816] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.879999] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.879999] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.879999] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.880171] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.880263] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.880360] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.882131] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-b43bd28d-5ebe-4bc9-9633-8ce0072566b1 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.883261] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b43bd28d-5ebe-4bc9-9633-8ce0072566b1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.883261] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b43bd28d-5ebe-4bc9-9633-8ce0072566b1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.883261] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b43bd28d-5ebe-4bc9-9633-8ce0072566b1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.883261] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b43bd28d-5ebe-4bc9-9633-8ce0072566b1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.157687] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6cf0f63-443c-4fdc-9d02-4df041c1ea64 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.160524] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6cf0f63-443c-4fdc-9d02-4df041c1ea64" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.160524] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6cf0f63-443c-4fdc-9d02-4df041c1ea64" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.160524] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6cf0f63-443c-4fdc-9d02-4df041c1ea64" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.160524] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.160524] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.160524] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.160524] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.160524] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.160524] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6cf0f63-443c-4fdc-9d02-4df041c1ea64" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.160524] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6cf0f63-443c-4fdc-9d02-4df041c1ea64 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.160524] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6cf0f63-443c-4fdc-9d02-4df041c1ea64" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.167739] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6cf0f63-443c-4fdc-9d02-4df041c1ea64" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.167739] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6cf0f63-443c-4fdc-9d02-4df041c1ea64" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.167739] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.167739] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.167739] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.167739] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.167739] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.167739] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6cf0f63-443c-4fdc-9d02-4df041c1ea64" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.167739] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c6cf0f63-443c-4fdc-9d02-4df041c1ea64',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.167739] env[69506]: INFO networking_nsxv3.common.synchronization [req-de1a0612-577f-4612-b2bf-71e14d8a9b62 req-11980d8f-b819-4c7c-aa88-96101a54ce49 tempest-AttachInterfacesUnderV243Test-153413102 tempest-AttachInterfacesUnderV243Test-153413102-project-member] Enqueued Resource ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 with Priority: HIGHEST for action security_group_members [ 649.170418] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 with Priority: HIGHEST for action security_group_members [ 649.170854] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-74c7c33d-c19d-4ab6-af56-0941c2240118 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.171152] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.174419] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.174419] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.174419] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.174419] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.174419] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.174419] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.174419] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.174419] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74c7c33d-c19d-4ab6-af56-0941c2240118',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.187321] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3e22dbe2-aa58-4758-a0a2-f2b363fb399a [ 649.187321] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.187321] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.187321] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.187321] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.187321] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.187321] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3e22dbe2-aa58-4758-a0a2-f2b363fb399a already deleted. [ 649.187321] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e22dbe2-aa58-4758-a0a2-f2b363fb399a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.385471] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.386575] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-008501d4-938b-4336-9c1d-ef3665f7d09d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.386712] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.386763] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b43bd28d-5ebe-4bc9-9633-8ce0072566b1 with status ACTIVE [ 649.386933] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.387063] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.387150] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.387834] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.387834] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.394167] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.394167] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.394167] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.394167] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.394167] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.394167] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.394167] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.394167] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.394167] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.394167] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.394167] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b43bd28d-5ebe-4bc9-9633-8ce0072566b1 is going to be updated. [ 649.414961] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.414961] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.414961] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.414961] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.414961] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.414961] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b43bd28d-5ebe-4bc9-9633-8ce0072566b1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.669345] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c6cf0f63-443c-4fdc-9d02-4df041c1ea64: rpc.has_security_group_logging(os_id): False [ 649.675608] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.676276] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.676400] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.678160] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.678313] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.679124] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.679273] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.679878] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.679878] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.679878] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.679878] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 already deleted. [ 649.679878] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.689502] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.689698] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.689775] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.689972] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.690643] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.690643] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.690643] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.690643] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.690643] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.690643] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.691135] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.691135] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.691135] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.691242] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.691242] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.691946] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.691946] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.691946] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.691946] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.691946] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.691946] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6cf0f63-443c-4fdc-9d02-4df041c1ea64 is going to be created. [ 649.751504] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.751739] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.751739] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.752069] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.752255] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.763394] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6cf0f63-443c-4fdc-9d02-4df041c1ea64 in Status: IN_PROGRESS for 2s [ 649.853837] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-690 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.853837] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-690" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.853837] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-690" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.853837] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-690" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.854235] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.854402] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.854553] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.854814] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.854997] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.855284] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 649.855440] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 649.855581] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 649.855719] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 649.855857] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 649.856010] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 649.856396] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 649.878173] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 649.878173] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 649.878259] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 649.878452] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-690" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.878807] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-d10a6ff2-e16a-473b-aaca-5898c5e09055 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.879014] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-d10a6ff2-e16a-473b-aaca-5898c5e09055" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.879176] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-d10a6ff2-e16a-473b-aaca-5898c5e09055" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.879506] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-d10a6ff2-e16a-473b-aaca-5898c5e09055" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.879985] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d10a6ff2-e16a-473b-aaca-5898c5e09055',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.893540] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.384833] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.385148] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.385148] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.385533] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.386119] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.386119] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port d10a6ff2-e16a-473b-aaca-5898c5e09055 not found, creating... [ 650.386303] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.386470] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.386636] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.386935] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.387172] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.387494] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.387667] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.387862] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.388194] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.388370] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.388578] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: d10a6ff2-e16a-473b-aaca-5898c5e09055 is going to be created. [ 650.395470] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.395628] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.395715] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.395923] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.396062] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.396114] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 008501d4-938b-4336-9c1d-ef3665f7d09d is going to be created. [ 650.418980] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.419325] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.419476] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.419754] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.419982] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.420218] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-d10a6ff2-e16a-473b-aaca-5898c5e09055" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.425905] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.426057] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.426130] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.426329] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.426473] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.436593] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 008501d4-938b-4336-9c1d-ef3665f7d09d in Status: UNINITIALIZED for 2s [ 650.773888] env[69506]: INFO networking_nsxv3.common.synchronization [req-6891ea95-a4a8-4b68-93ca-1ba3b3f935ff req-15fcfc5d-ac95-4839-95dc-19a0f001713c service nova] Enqueued Resource ID: 0745f36a-3469-4c49-9c0f-8111fe1bd802 with Priority: HIGHEST for action security_group_rules [ 650.774041] env[69506]: INFO networking_nsxv3.common.synchronization [req-6891ea95-a4a8-4b68-93ca-1ba3b3f935ff req-15fcfc5d-ac95-4839-95dc-19a0f001713c service nova] Enqueued Resource ID: 0745f36a-3469-4c49-9c0f-8111fe1bd802 with Priority: HIGHEST for action security_group_members [ 650.774074] env[69506]: INFO networking_nsxv3.common.synchronization [req-6891ea95-a4a8-4b68-93ca-1ba3b3f935ff req-15fcfc5d-ac95-4839-95dc-19a0f001713c service nova] Enqueued Resource ID: 23330338-bd2d-4050-a412-bba2d9a797bf with Priority: HIGHEST for action port [ 650.774308] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0745f36a-3469-4c49-9c0f-8111fe1bd802 with Priority: HIGHEST for action security_group_rules [ 650.774433] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0745f36a-3469-4c49-9c0f-8111fe1bd802 with Priority: HIGHEST for action security_group_members [ 650.774524] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23330338-bd2d-4050-a412-bba2d9a797bf with Priority: HIGHEST for action port [ 650.776703] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0745f36a-3469-4c49-9c0f-8111fe1bd802 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.776887] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.777194] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.779380] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.779380] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0745f36a-3469-4c49-9c0f-8111fe1bd802',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.782311] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0745f36a-3469-4c49-9c0f-8111fe1bd802 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.782311] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.782311] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.782311] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.782311] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.782311] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.782311] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.786586] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.786586] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.786586] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0745f36a-3469-4c49-9c0f-8111fe1bd802',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.786586] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-23330338-bd2d-4050-a412-bba2d9a797bf taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.786586] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23330338-bd2d-4050-a412-bba2d9a797bf" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.786586] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23330338-bd2d-4050-a412-bba2d9a797bf" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.786586] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23330338-bd2d-4050-a412-bba2d9a797bf" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.786586] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23330338-bd2d-4050-a412-bba2d9a797bf',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.221850] env[69506]: INFO networking_nsxv3.common.synchronization [None req-db2bff9a-b558-466b-b537-d3bcae21a0a7 None None] Enqueued Resource ID: dc221839-0951-47ab-95e5-9e6b4aaba387 with Priority: HIGHEST for action port [ 651.222119] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc221839-0951-47ab-95e5-9e6b4aaba387 with Priority: HIGHEST for action port [ 651.222690] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc221839-0951-47ab-95e5-9e6b4aaba387 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.222835] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc221839-0951-47ab-95e5-9e6b4aaba387" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.222907] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc221839-0951-47ab-95e5-9e6b4aaba387" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.224166] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc221839-0951-47ab-95e5-9e6b4aaba387" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.224166] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc221839-0951-47ab-95e5-9e6b4aaba387',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.288218] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0745f36a-3469-4c49-9c0f-8111fe1bd802',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.288707] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0745f36a-3469-4c49-9c0f-8111fe1bd802 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.288828] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.289067] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 23330338-bd2d-4050-a412-bba2d9a797bf with status ACTIVE [ 651.289175] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.289284] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.289367] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.289542] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.289639] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.289788] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.289884] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.289935] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.290110] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.290188] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.290361] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.290452] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.290503] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.290637] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.290706] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.291221] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 23330338-bd2d-4050-a412-bba2d9a797bf is going to be updated. [ 651.323370] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.323370] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.323370] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.323370] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.323370] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.323370] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23330338-bd2d-4050-a412-bba2d9a797bf" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.727771] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dc221839-0951-47ab-95e5-9e6b4aaba387 [ 651.727771] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.727771] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.727771] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.728110] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.728110] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.728110] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dc221839-0951-47ab-95e5-9e6b4aaba387 already deleted. [ 651.728110] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc221839-0951-47ab-95e5-9e6b4aaba387" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.735807] env[69506]: INFO networking_nsxv3.common.synchronization [None req-89dd771a-0752-4805-94cb-349e3b926396 None None] Enqueued Resource ID: aaeea5ea-8639-40e8-8ddc-b9b54e830889 with Priority: HIGHEST for action port [ 651.736213] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaeea5ea-8639-40e8-8ddc-b9b54e830889 with Priority: HIGHEST for action port [ 651.736618] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-aaeea5ea-8639-40e8-8ddc-b9b54e830889 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.736746] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aaeea5ea-8639-40e8-8ddc-b9b54e830889" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.736812] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aaeea5ea-8639-40e8-8ddc-b9b54e830889" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.737172] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aaeea5ea-8639-40e8-8ddc-b9b54e830889" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.737522] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aaeea5ea-8639-40e8-8ddc-b9b54e830889',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.741679] env[69506]: INFO networking_nsxv3.common.synchronization [req-de1a0612-577f-4612-b2bf-71e14d8a9b62 req-62daee76-706c-4df1-bdaf-778e9d0f8059 service nova] Enqueued Resource ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 with Priority: HIGHEST for action security_group_rules [ 651.741679] env[69506]: INFO networking_nsxv3.common.synchronization [req-de1a0612-577f-4612-b2bf-71e14d8a9b62 req-62daee76-706c-4df1-bdaf-778e9d0f8059 service nova] Enqueued Resource ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 with Priority: HIGHEST for action security_group_members [ 651.741679] env[69506]: INFO networking_nsxv3.common.synchronization [req-de1a0612-577f-4612-b2bf-71e14d8a9b62 req-62daee76-706c-4df1-bdaf-778e9d0f8059 service nova] Enqueued Resource ID: d10a6ff2-e16a-473b-aaca-5898c5e09055 with Priority: HIGHEST for action port [ 651.741679] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 with Priority: HIGHEST for action security_group_rules [ 651.741679] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 with Priority: HIGHEST for action security_group_members [ 651.741904] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d10a6ff2-e16a-473b-aaca-5898c5e09055 with Priority: HIGHEST for action port [ 651.742964] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-74c7c33d-c19d-4ab6-af56-0941c2240118 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.742964] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.742964] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.742964] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.742964] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('74c7c33d-c19d-4ab6-af56-0941c2240118',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.744367] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-74c7c33d-c19d-4ab6-af56-0941c2240118 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.744367] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.744367] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.744367] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.744951] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.744951] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.745078] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.745233] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.745328] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.745434] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74c7c33d-c19d-4ab6-af56-0941c2240118',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.750683] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-d10a6ff2-e16a-473b-aaca-5898c5e09055 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.750683] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d10a6ff2-e16a-473b-aaca-5898c5e09055" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.750683] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d10a6ff2-e16a-473b-aaca-5898c5e09055" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.750683] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d10a6ff2-e16a-473b-aaca-5898c5e09055" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.750683] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d10a6ff2-e16a-473b-aaca-5898c5e09055',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.778096] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6cf0f63-443c-4fdc-9d02-4df041c1ea64 in Status: SUCCESS [ 651.778418] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6cf0f63-443c-4fdc-9d02-4df041c1ea64" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.802657] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0745f36a-3469-4c49-9c0f-8111fe1bd802',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.070746] env[69506]: INFO networking_nsxv3.common.synchronization [req-7c1e2ad9-d293-4ef1-a79e-70bc0f26eb9a req-a2ba80d6-a629-4ce9-887f-f9908ac5f815 tempest-SecurityGroupRulesTestJSON-2004689177 tempest-SecurityGroupRulesTestJSON-2004689177-project-member] Enqueued Resource ID: 136d89b0-e32e-48fa-9cca-bf6d8791e6dc with Priority: HIGHEST for action security_group_rules [ 652.072016] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 136d89b0-e32e-48fa-9cca-bf6d8791e6dc with Priority: HIGHEST for action security_group_rules [ 652.072016] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-136d89b0-e32e-48fa-9cca-bf6d8791e6dc taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.072016] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-136d89b0-e32e-48fa-9cca-bf6d8791e6dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.072016] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-136d89b0-e32e-48fa-9cca-bf6d8791e6dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.072230] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-136d89b0-e32e-48fa-9cca-bf6d8791e6dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.072263] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('136d89b0-e32e-48fa-9cca-bf6d8791e6dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.243370] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aaeea5ea-8639-40e8-8ddc-b9b54e830889 [ 652.243608] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.243751] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.243814] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.244045] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.244139] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.244240] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aaeea5ea-8639-40e8-8ddc-b9b54e830889 already deleted. [ 652.244317] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aaeea5ea-8639-40e8-8ddc-b9b54e830889" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.250972] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-74c7c33d-c19d-4ab6-af56-0941c2240118 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.250972] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.251349] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('74c7c33d-c19d-4ab6-af56-0941c2240118',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.252058] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d10a6ff2-e16a-473b-aaca-5898c5e09055 with status ACTIVE [ 652.252247] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.252384] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.252433] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.252631] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.252714] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.253037] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.253037] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.253037] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.253208] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.253548] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.253548] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.253548] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.253690] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.253738] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.253811] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.253890] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d10a6ff2-e16a-473b-aaca-5898c5e09055 is going to be updated. [ 652.279675] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.279821] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.279895] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.280176] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.280305] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.280462] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d10a6ff2-e16a-473b-aaca-5898c5e09055" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.307261] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.307261] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.307261] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.307261] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.307261] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.307261] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0745f36a-3469-4c49-9c0f-8111fe1bd802 is going to be created. [ 652.332251] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.332251] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.332251] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.332251] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.332251] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.342351] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0745f36a-3469-4c49-9c0f-8111fe1bd802 in Status: UNINITIALIZED for 2s [ 652.452032] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 008501d4-938b-4336-9c1d-ef3665f7d09d in Status: SUCCESS [ 652.452032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.452032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.452032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.453525] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.453771] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.453771] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.453910] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.453991] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.454101] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.454188] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.499153] env[69506]: INFO networking_nsxv3.common.synchronization [None req-0af408af-a65a-4751-b6a5-af1aaaffdea1 None None] Enqueued Resource ID: 7dcbdb63-a0b7-4bb1-9bb1-b81a14e18427 with Priority: HIGHEST for action port [ 652.499153] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dcbdb63-a0b7-4bb1-9bb1-b81a14e18427 with Priority: HIGHEST for action port [ 652.499153] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-7dcbdb63-a0b7-4bb1-9bb1-b81a14e18427 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.499153] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7dcbdb63-a0b7-4bb1-9bb1-b81a14e18427" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.499153] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7dcbdb63-a0b7-4bb1-9bb1-b81a14e18427" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.499153] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7dcbdb63-a0b7-4bb1-9bb1-b81a14e18427" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.499153] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7dcbdb63-a0b7-4bb1-9bb1-b81a14e18427',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.593188] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.593344] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.593414] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.593636] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.593719] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.593816] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 136d89b0-e32e-48fa-9cca-bf6d8791e6dc already deleted. [ 652.593921] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-136d89b0-e32e-48fa-9cca-bf6d8791e6dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.760519] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('74c7c33d-c19d-4ab6-af56-0941c2240118',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.960052] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-008501d4-938b-4336-9c1d-ef3665f7d09d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.960052] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.960052] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.960323] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.960454] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.960567] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.960638] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.960799] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.960887] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.960978] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.961169] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-008501d4-938b-4336-9c1d-ef3665f7d09d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.961266] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.961373] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.961539] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.961704] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.961798] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.961857] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.961994] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.962082] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.962552] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.962708] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.001253] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7dcbdb63-a0b7-4bb1-9bb1-b81a14e18427 [ 653.001253] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.001394] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.001394] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.001566] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.001653] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.001747] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7dcbdb63-a0b7-4bb1-9bb1-b81a14e18427 already deleted. [ 653.001823] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7dcbdb63-a0b7-4bb1-9bb1-b81a14e18427" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.091777] env[69506]: INFO networking_nsxv3.common.synchronization [req-c9a8bc2e-0bf0-489a-96dd-4743e3d06d8b req-c2b3bea1-c2dd-4950-b695-0cc69dbe2349 tempest-ServerDiagnosticsNegativeTest-931616368 tempest-ServerDiagnosticsNegativeTest-931616368-project-member] Enqueued Resource ID: 45d4afae-b465-436c-9353-5ec36cb81429 with Priority: HIGHEST for action security_group_members [ 653.092150] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45d4afae-b465-436c-9353-5ec36cb81429 with Priority: HIGHEST for action security_group_members [ 653.095902] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-45d4afae-b465-436c-9353-5ec36cb81429 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.096063] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45d4afae-b465-436c-9353-5ec36cb81429" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.096133] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45d4afae-b465-436c-9353-5ec36cb81429" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.096499] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45d4afae-b465-436c-9353-5ec36cb81429" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.096594] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.096705] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.096771] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.098373] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.098373] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.098373] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45d4afae-b465-436c-9353-5ec36cb81429',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.264763] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.264763] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.264763] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.264763] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.264763] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.264763] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 is going to be created. [ 653.284405] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.284490] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.284556] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.284757] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.284910] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.290299] env[69506]: INFO networking_nsxv3.common.synchronization [None req-053d1a5e-f889-4097-a2fb-a7fcbffac7bb None None] Enqueued Resource ID: 6991c8ae-36c2-476c-927f-3edf8c744bdf with Priority: HIGHEST for action port [ 653.291253] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6991c8ae-36c2-476c-927f-3edf8c744bdf with Priority: HIGHEST for action port [ 653.291576] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-6991c8ae-36c2-476c-927f-3edf8c744bdf taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.292125] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6991c8ae-36c2-476c-927f-3edf8c744bdf" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.292125] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6991c8ae-36c2-476c-927f-3edf8c744bdf" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.294530] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6991c8ae-36c2-476c-927f-3edf8c744bdf" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.294656] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6991c8ae-36c2-476c-927f-3edf8c744bdf',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.296146] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 in Status: UNINITIALIZED for 2s [ 653.465883] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 008501d4-938b-4336-9c1d-ef3665f7d09d: rpc.has_security_group_logging(os_id): False [ 653.482996] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.482996] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.482996] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.483383] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.483470] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.483807] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.483899] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.483899] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.484056] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.484130] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.484377] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.484499] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.485103] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.485103] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.485103] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.485103] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.485489] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.485551] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.485858] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.485858] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.485858] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 008501d4-938b-4336-9c1d-ef3665f7d09d is going to be created. [ 653.540499] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.540717] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.540717] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.540897] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.541134] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.552370] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 008501d4-938b-4336-9c1d-ef3665f7d09d in Status: IN_PROGRESS for 2s [ 653.599375] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.599545] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.599640] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.599892] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.600098] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.600225] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.600285] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.600316] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.600470] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.600548] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.600630] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45d4afae-b465-436c-9353-5ec36cb81429 already deleted. [ 653.600714] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45d4afae-b465-436c-9353-5ec36cb81429" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.679019] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-438 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.679019] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.679019] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.679019] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.679019] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.679019] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.679019] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.679019] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.679019] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.679019] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 653.679739] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 653.680801] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 653.681100] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 653.681355] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 653.681632] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 653.683892] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 653.703025] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 653.703025] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 653.703025] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 653.703025] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.703025] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-0617601e-65dd-4ea0-8a9d-3dca132c24f7 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.703025] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-0617601e-65dd-4ea0-8a9d-3dca132c24f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.703025] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-0617601e-65dd-4ea0-8a9d-3dca132c24f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.703025] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-0617601e-65dd-4ea0-8a9d-3dca132c24f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.703025] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0617601e-65dd-4ea0-8a9d-3dca132c24f7',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.781454] env[69506]: INFO networking_nsxv3.common.synchronization [None req-ae9c0064-68f6-4ae1-a791-fdcdb83bfc1c tempest-AttachInterfacesTestJSON-2055467997 tempest-AttachInterfacesTestJSON-2055467997-project-member] Enqueued Resource ID: 56702d6b-7f85-46e1-bf9f-c5bba683fb41 with Priority: HIGHEST for action security_group_rules [ 653.781454] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56702d6b-7f85-46e1-bf9f-c5bba683fb41 with Priority: HIGHEST for action security_group_rules [ 653.781454] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-56702d6b-7f85-46e1-bf9f-c5bba683fb41 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.781454] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-56702d6b-7f85-46e1-bf9f-c5bba683fb41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.781454] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-56702d6b-7f85-46e1-bf9f-c5bba683fb41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.781454] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-56702d6b-7f85-46e1-bf9f-c5bba683fb41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.781454] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('56702d6b-7f85-46e1-bf9f-c5bba683fb41',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.798554] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6991c8ae-36c2-476c-927f-3edf8c744bdf [ 653.798695] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.798825] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.798961] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.799154] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.799259] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.799361] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6991c8ae-36c2-476c-927f-3edf8c744bdf already deleted. [ 653.799461] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6991c8ae-36c2-476c-927f-3edf8c744bdf" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.028288] env[69506]: INFO networking_nsxv3.common.synchronization [None req-51f204b5-d282-45cf-be95-3aeccc219b94 tempest-AttachInterfacesTestJSON-2055467997 tempest-AttachInterfacesTestJSON-2055467997-project-member] Enqueued Resource ID: 56702d6b-7f85-46e1-bf9f-c5bba683fb41 with Priority: HIGHEST for action security_group_rules [ 654.028815] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56702d6b-7f85-46e1-bf9f-c5bba683fb41 with Priority: HIGHEST for action security_group_rules [ 654.029539] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-56702d6b-7f85-46e1-bf9f-c5bba683fb41 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.029539] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-56702d6b-7f85-46e1-bf9f-c5bba683fb41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.206963] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.207396] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.207396] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.207795] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.207795] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.208044] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 0617601e-65dd-4ea0-8a9d-3dca132c24f7 not found, creating... [ 654.208308] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.208459] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.208600] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.208821] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.209235] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.209635] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.209809] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.209953] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.210207] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.210339] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.210559] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 0617601e-65dd-4ea0-8a9d-3dca132c24f7 is going to be created. [ 654.234391] env[69506]: INFO networking_nsxv3.common.synchronization [None req-f9610287-63ce-4c65-94c8-5980a14b4385 None None] Enqueued Resource ID: a124cf7b-475d-4537-b7b9-27753dc7c3ed with Priority: HIGHEST for action port [ 654.234391] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a124cf7b-475d-4537-b7b9-27753dc7c3ed with Priority: HIGHEST for action port [ 654.234874] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-a124cf7b-475d-4537-b7b9-27753dc7c3ed taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.235045] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a124cf7b-475d-4537-b7b9-27753dc7c3ed" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.235190] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a124cf7b-475d-4537-b7b9-27753dc7c3ed" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.235422] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a124cf7b-475d-4537-b7b9-27753dc7c3ed" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.235508] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a124cf7b-475d-4537-b7b9-27753dc7c3ed',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.240192] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.240192] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.240192] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.240192] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.240192] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.240536] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-0617601e-65dd-4ea0-8a9d-3dca132c24f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.306655] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.306655] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.306655] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.306655] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.307053] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.307053] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 56702d6b-7f85-46e1-bf9f-c5bba683fb41 already deleted. [ 654.307053] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-56702d6b-7f85-46e1-bf9f-c5bba683fb41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.307833] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-56702d6b-7f85-46e1-bf9f-c5bba683fb41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.307833] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-56702d6b-7f85-46e1-bf9f-c5bba683fb41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.307833] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('56702d6b-7f85-46e1-bf9f-c5bba683fb41',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.351408] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0745f36a-3469-4c49-9c0f-8111fe1bd802 in Status: SUCCESS [ 654.351408] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.351408] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.351408] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.351408] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.351408] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.351408] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.351408] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.351408] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.351408] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.351408] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0745f36a-3469-4c49-9c0f-8111fe1bd802',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.739216] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a124cf7b-475d-4537-b7b9-27753dc7c3ed [ 654.739216] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.739216] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.739216] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.739216] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.739216] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.739216] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a124cf7b-475d-4537-b7b9-27753dc7c3ed already deleted. [ 654.739216] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a124cf7b-475d-4537-b7b9-27753dc7c3ed" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.836487] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.836487] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.836487] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.836487] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.836487] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.836487] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 56702d6b-7f85-46e1-bf9f-c5bba683fb41 already deleted. [ 654.836487] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-56702d6b-7f85-46e1-bf9f-c5bba683fb41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.853807] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0745f36a-3469-4c49-9c0f-8111fe1bd802 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.853963] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.854044] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.854275] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.854436] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.854526] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.854587] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.854744] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.854812] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.854885] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.855039] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0745f36a-3469-4c49-9c0f-8111fe1bd802 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.855129] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.855186] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.856032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.856032] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.856032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.856032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.856032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.856032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.856032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.856032] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0745f36a-3469-4c49-9c0f-8111fe1bd802',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.911970] env[69506]: INFO networking_nsxv3.common.synchronization [None req-eb6da717-024d-4cc4-b7d0-1f36ba47a015 None None] Enqueued Resource ID: ec6f84b3-30ee-4d4f-8269-6504bf1ace82 with Priority: HIGHEST for action port [ 654.911970] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec6f84b3-30ee-4d4f-8269-6504bf1ace82 with Priority: HIGHEST for action port [ 654.911970] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec6f84b3-30ee-4d4f-8269-6504bf1ace82 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.911970] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec6f84b3-30ee-4d4f-8269-6504bf1ace82" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.911970] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec6f84b3-30ee-4d4f-8269-6504bf1ace82" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.911970] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec6f84b3-30ee-4d4f-8269-6504bf1ace82" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.911970] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec6f84b3-30ee-4d4f-8269-6504bf1ace82',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.180480] env[69506]: INFO networking_nsxv3.common.synchronization [req-aec1562f-ec46-44ea-86a4-403215db64d0 req-293fb6b8-acb8-46fb-aada-be568a25ce82 tempest-FloatingIPsAssociationTestJSON-642147526 tempest-FloatingIPsAssociationTestJSON-642147526-project-member] Enqueued Resource ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 with Priority: HIGHEST for action security_group_members [ 655.181816] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 with Priority: HIGHEST for action security_group_members [ 655.182256] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-56c2fe94-2993-4f31-a331-b0611a88cec2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.182379] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.182379] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.182643] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.182802] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.182902] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.182963] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.183133] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.183224] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.183384] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56c2fe94-2993-4f31-a331-b0611a88cec2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.305885] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 in Status: SUCCESS [ 655.306620] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.306620] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.307033] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.307309] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.307571] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.307571] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.307795] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.307925] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.308066] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.308207] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('74c7c33d-c19d-4ab6-af56-0941c2240118',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.361307] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0745f36a-3469-4c49-9c0f-8111fe1bd802: rpc.has_security_group_logging(os_id): False [ 655.381168] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.381168] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.381168] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.381168] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.381168] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.381168] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.381168] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.381168] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.381168] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.381168] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.381168] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.381168] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.381168] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.381168] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.381168] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.382549] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.382549] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.382549] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.382549] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.382549] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.382549] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0745f36a-3469-4c49-9c0f-8111fe1bd802 is going to be created. [ 655.412391] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ec6f84b3-30ee-4d4f-8269-6504bf1ace82 [ 655.412633] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.412770] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.412842] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.414131] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.414131] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.414131] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ec6f84b3-30ee-4d4f-8269-6504bf1ace82 already deleted. [ 655.414131] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec6f84b3-30ee-4d4f-8269-6504bf1ace82" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.436252] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.436403] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.436474] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.436693] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.436869] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.447817] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0745f36a-3469-4c49-9c0f-8111fe1bd802 in Status: IN_PROGRESS for 2s [ 655.489311] env[69506]: INFO networking_nsxv3.common.synchronization [req-c9a8bc2e-0bf0-489a-96dd-4743e3d06d8b req-dec39c22-84f2-4c38-8487-e7e51f089db1 service nova] Enqueued Resource ID: 45d4afae-b465-436c-9353-5ec36cb81429 with Priority: HIGHEST for action security_group_rules [ 655.489512] env[69506]: INFO networking_nsxv3.common.synchronization [req-c9a8bc2e-0bf0-489a-96dd-4743e3d06d8b req-dec39c22-84f2-4c38-8487-e7e51f089db1 service nova] Enqueued Resource ID: 45d4afae-b465-436c-9353-5ec36cb81429 with Priority: HIGHEST for action security_group_members [ 655.491334] env[69506]: INFO networking_nsxv3.common.synchronization [req-c9a8bc2e-0bf0-489a-96dd-4743e3d06d8b req-dec39c22-84f2-4c38-8487-e7e51f089db1 service nova] Enqueued Resource ID: 0617601e-65dd-4ea0-8a9d-3dca132c24f7 with Priority: HIGHEST for action port [ 655.493735] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45d4afae-b465-436c-9353-5ec36cb81429 with Priority: HIGHEST for action security_group_rules [ 655.493896] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45d4afae-b465-436c-9353-5ec36cb81429 with Priority: HIGHEST for action security_group_members [ 655.493993] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0617601e-65dd-4ea0-8a9d-3dca132c24f7 with Priority: HIGHEST for action port [ 655.494339] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45d4afae-b465-436c-9353-5ec36cb81429 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.494479] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45d4afae-b465-436c-9353-5ec36cb81429" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.494906] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45d4afae-b465-436c-9353-5ec36cb81429" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.494906] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45d4afae-b465-436c-9353-5ec36cb81429" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.494906] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45d4afae-b465-436c-9353-5ec36cb81429',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.502382] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-45d4afae-b465-436c-9353-5ec36cb81429 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.502613] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45d4afae-b465-436c-9353-5ec36cb81429" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.502700] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45d4afae-b465-436c-9353-5ec36cb81429" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.502939] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45d4afae-b465-436c-9353-5ec36cb81429" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.503153] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.503262] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.503401] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.504166] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.504166] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.504166] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45d4afae-b465-436c-9353-5ec36cb81429',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.507655] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-0617601e-65dd-4ea0-8a9d-3dca132c24f7 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.507655] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0617601e-65dd-4ea0-8a9d-3dca132c24f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.507655] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0617601e-65dd-4ea0-8a9d-3dca132c24f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.507655] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0617601e-65dd-4ea0-8a9d-3dca132c24f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.507655] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0617601e-65dd-4ea0-8a9d-3dca132c24f7',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.573317] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 008501d4-938b-4336-9c1d-ef3665f7d09d in Status: SUCCESS [ 655.573454] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.687647] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.687893] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.687893] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.688199] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.688265] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.688552] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.688712] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.688712] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.688849] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.688906] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.688961] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 already deleted. [ 655.689054] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.810804] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('74c7c33d-c19d-4ab6-af56-0941c2240118',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.009729] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-45d4afae-b465-436c-9353-5ec36cb81429 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.010394] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45d4afae-b465-436c-9353-5ec36cb81429" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.012555] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0617601e-65dd-4ea0-8a9d-3dca132c24f7 with status ACTIVE [ 656.012555] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.012555] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.012555] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.012555] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.012555] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.012555] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.012555] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.012555] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.012555] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.012940] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.012940] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.012940] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.012940] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.013118] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.013157] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.013298] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0617601e-65dd-4ea0-8a9d-3dca132c24f7 is going to be updated. [ 656.014435] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45d4afae-b465-436c-9353-5ec36cb81429',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.039271] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.039271] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.039271] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.039558] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.039608] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.042020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0617601e-65dd-4ea0-8a9d-3dca132c24f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.182981] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-176 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.183071] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-176" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.183915] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-176" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.183915] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-176" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.183915] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.184327] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.184327] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.184327] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.184503] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.184695] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 656.184806] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 656.184912] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 656.185049] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 656.185140] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 656.185243] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 656.185526] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 656.206193] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 656.206193] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 656.206193] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 656.206193] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-176" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.206193] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-aba159d0-4f1e-4de2-b3dc-006274ff75b7 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.206193] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-aba159d0-4f1e-4de2-b3dc-006274ff75b7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.206193] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-aba159d0-4f1e-4de2-b3dc-006274ff75b7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.206193] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-aba159d0-4f1e-4de2-b3dc-006274ff75b7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.206193] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aba159d0-4f1e-4de2-b3dc-006274ff75b7',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.214778] env[69506]: INFO networking_nsxv3.common.synchronization [None req-42046ead-0a99-4ec0-acbb-94ecc2ecc583 tempest-VolumesAdminNegativeTest-1438419906 tempest-VolumesAdminNegativeTest-1438419906-project-member] Enqueued Resource ID: 1bceaf9d-1c44-4281-83d2-4109ac0771c7 with Priority: HIGHEST for action security_group_rules [ 656.214778] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bceaf9d-1c44-4281-83d2-4109ac0771c7 with Priority: HIGHEST for action security_group_rules [ 656.215511] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bceaf9d-1c44-4281-83d2-4109ac0771c7 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.215895] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.215895] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.215997] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.216061] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bceaf9d-1c44-4281-83d2-4109ac0771c7',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.286634] env[69506]: INFO networking_nsxv3.common.synchronization [None req-054c152e-3bdf-4e7f-b999-191d673636b2 None None] Enqueued Resource ID: 8926bcd7-cf7b-4c99-a717-10c9ecd6388a with Priority: HIGHEST for action port [ 656.287780] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8926bcd7-cf7b-4c99-a717-10c9ecd6388a with Priority: HIGHEST for action port [ 656.288504] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-8926bcd7-cf7b-4c99-a717-10c9ecd6388a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.291686] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8926bcd7-cf7b-4c99-a717-10c9ecd6388a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.291686] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8926bcd7-cf7b-4c99-a717-10c9ecd6388a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.291686] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8926bcd7-cf7b-4c99-a717-10c9ecd6388a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.291686] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8926bcd7-cf7b-4c99-a717-10c9ecd6388a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.314361] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 74c7c33d-c19d-4ab6-af56-0941c2240118: rpc.has_security_group_logging(os_id): False [ 656.330733] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.330925] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.330971] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.331197] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.331275] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.331541] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.331595] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.331655] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.334302] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.334302] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.334302] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 is going to be created. [ 656.389055] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.389055] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.389055] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.389055] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.389055] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.397766] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 in Status: IN_PROGRESS for 2s [ 656.481148] env[69506]: INFO networking_nsxv3.common.synchronization [None req-625d45e0-3437-409d-bd6f-11715a8be813 tempest-VolumesAdminNegativeTest-1438419906 tempest-VolumesAdminNegativeTest-1438419906-project-member] Enqueued Resource ID: 1bceaf9d-1c44-4281-83d2-4109ac0771c7 with Priority: HIGHEST for action security_group_rules [ 656.482423] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bceaf9d-1c44-4281-83d2-4109ac0771c7 with Priority: HIGHEST for action security_group_rules [ 656.482835] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bceaf9d-1c44-4281-83d2-4109ac0771c7 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.483076] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.517655] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45d4afae-b465-436c-9353-5ec36cb81429',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.685807] env[69506]: INFO networking_nsxv3.common.synchronization [req-5066d7ba-fafe-460e-9126-158b553de5b8 req-78d5c6ed-2354-4379-849b-7c5854f36a8d tempest-SecurityGroupRulesTestJSON-2004689177 tempest-SecurityGroupRulesTestJSON-2004689177-project-member] Enqueued Resource ID: d50d83ce-ab11-44ab-9f2e-779cd16b8320 with Priority: HIGHEST for action security_group_rules [ 656.686346] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d50d83ce-ab11-44ab-9f2e-779cd16b8320 with Priority: HIGHEST for action security_group_rules [ 656.686658] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d50d83ce-ab11-44ab-9f2e-779cd16b8320 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.686777] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d50d83ce-ab11-44ab-9f2e-779cd16b8320" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.687057] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d50d83ce-ab11-44ab-9f2e-779cd16b8320" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.687375] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d50d83ce-ab11-44ab-9f2e-779cd16b8320" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.687505] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d50d83ce-ab11-44ab-9f2e-779cd16b8320',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.710423] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.710636] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.710760] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.711039] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.711227] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.711410] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port aba159d0-4f1e-4de2-b3dc-006274ff75b7 not found, creating... [ 656.711841] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.714022] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.714022] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.714022] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.714022] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.714022] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.714022] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.714022] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.714687] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.714868] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.715028] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: aba159d0-4f1e-4de2-b3dc-006274ff75b7 is going to be created. [ 656.733377] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.733570] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.733641] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.733879] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.733962] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.734069] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bceaf9d-1c44-4281-83d2-4109ac0771c7 already deleted. [ 656.734154] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.734294] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.734459] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.734577] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bceaf9d-1c44-4281-83d2-4109ac0771c7',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.737687] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.737899] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.738039] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.738287] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.738515] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.738738] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-aba159d0-4f1e-4de2-b3dc-006274ff75b7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.793412] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8926bcd7-cf7b-4c99-a717-10c9ecd6388a [ 656.793672] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.793858] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.793963] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.794312] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.794458] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.794611] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8926bcd7-cf7b-4c99-a717-10c9ecd6388a already deleted. [ 656.794746] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8926bcd7-cf7b-4c99-a717-10c9ecd6388a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.020682] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.021362] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.021362] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.021362] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.021362] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.021362] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45d4afae-b465-436c-9353-5ec36cb81429 is going to be created. [ 657.045705] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.045705] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.045705] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.045705] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.045920] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.054444] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45d4afae-b465-436c-9353-5ec36cb81429 in Status: UNINITIALIZED for 2s [ 657.206896] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.207091] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.207220] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.207409] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.207510] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.207789] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d50d83ce-ab11-44ab-9f2e-779cd16b8320 already deleted. [ 657.207789] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d50d83ce-ab11-44ab-9f2e-779cd16b8320" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.260274] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.260833] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.260833] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.260833] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.260968] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.261033] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bceaf9d-1c44-4281-83d2-4109ac0771c7 already deleted. [ 657.261112] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.321215] env[69506]: INFO networking_nsxv3.common.synchronization [None req-6670a20d-1993-49e2-92ac-b4e4f5a10258 None None] Enqueued Resource ID: 94880bd0-0585-4d93-b3ae-09fdc51ea65e with Priority: HIGHEST for action port [ 657.321533] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94880bd0-0585-4d93-b3ae-09fdc51ea65e with Priority: HIGHEST for action port [ 657.322105] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-94880bd0-0585-4d93-b3ae-09fdc51ea65e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.322232] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94880bd0-0585-4d93-b3ae-09fdc51ea65e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.322291] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94880bd0-0585-4d93-b3ae-09fdc51ea65e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.322547] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94880bd0-0585-4d93-b3ae-09fdc51ea65e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.322631] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94880bd0-0585-4d93-b3ae-09fdc51ea65e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.459657] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0745f36a-3469-4c49-9c0f-8111fe1bd802 in Status: SUCCESS [ 657.459725] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.824376] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 94880bd0-0585-4d93-b3ae-09fdc51ea65e [ 657.826502] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.826502] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.826502] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.826502] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.826502] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.826502] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:94880bd0-0585-4d93-b3ae-09fdc51ea65e already deleted. [ 657.826502] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94880bd0-0585-4d93-b3ae-09fdc51ea65e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.410801] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 in Status: SUCCESS [ 658.411048] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.589763] env[69506]: INFO networking_nsxv3.common.synchronization [req-aec1562f-ec46-44ea-86a4-403215db64d0 req-b7704d11-c78f-4f32-95d7-8838fecbc82a service nova] Enqueued Resource ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 with Priority: HIGHEST for action security_group_rules [ 658.589844] env[69506]: INFO networking_nsxv3.common.synchronization [req-aec1562f-ec46-44ea-86a4-403215db64d0 req-b7704d11-c78f-4f32-95d7-8838fecbc82a service nova] Enqueued Resource ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 with Priority: HIGHEST for action security_group_members [ 658.589991] env[69506]: INFO networking_nsxv3.common.synchronization [req-aec1562f-ec46-44ea-86a4-403215db64d0 req-b7704d11-c78f-4f32-95d7-8838fecbc82a service nova] Enqueued Resource ID: aba159d0-4f1e-4de2-b3dc-006274ff75b7 with Priority: HIGHEST for action port [ 658.590230] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 with Priority: HIGHEST for action security_group_rules [ 658.590377] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 with Priority: HIGHEST for action security_group_members [ 658.590470] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aba159d0-4f1e-4de2-b3dc-006274ff75b7 with Priority: HIGHEST for action port [ 658.590985] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-56c2fe94-2993-4f31-a331-b0611a88cec2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.591518] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.591594] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.591868] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.591952] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('56c2fe94-2993-4f31-a331-b0611a88cec2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.592899] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-56c2fe94-2993-4f31-a331-b0611a88cec2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.594267] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.594365] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.594569] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.594732] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.594828] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.594892] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.595049] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.595137] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.595246] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56c2fe94-2993-4f31-a331-b0611a88cec2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.600037] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-aba159d0-4f1e-4de2-b3dc-006274ff75b7 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.600216] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aba159d0-4f1e-4de2-b3dc-006274ff75b7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.600294] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aba159d0-4f1e-4de2-b3dc-006274ff75b7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.600474] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aba159d0-4f1e-4de2-b3dc-006274ff75b7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.600553] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aba159d0-4f1e-4de2-b3dc-006274ff75b7',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.637022] env[69506]: INFO networking_nsxv3.common.synchronization [None req-1fded084-326c-4543-8ee6-f5d1bd1e8adf None None] Enqueued Resource ID: c10c686f-5a6b-4af7-9c3e-afe06aedb79b with Priority: HIGHEST for action port [ 658.637022] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c10c686f-5a6b-4af7-9c3e-afe06aedb79b with Priority: HIGHEST for action port [ 658.637339] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-c10c686f-5a6b-4af7-9c3e-afe06aedb79b taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.637441] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c10c686f-5a6b-4af7-9c3e-afe06aedb79b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.637441] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c10c686f-5a6b-4af7-9c3e-afe06aedb79b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.637727] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c10c686f-5a6b-4af7-9c3e-afe06aedb79b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.637806] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c10c686f-5a6b-4af7-9c3e-afe06aedb79b',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.979063] env[69506]: INFO networking_nsxv3.common.synchronization [req-010f296d-8fa2-4bde-9b43-ef304c581f14 req-a9eb16d7-d408-44ac-af0a-ca4e1a879da7 tempest-DeleteServersAdminTestJSON-749538940 tempest-DeleteServersAdminTestJSON-749538940-project-admin] Enqueued Resource ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 with Priority: HIGHEST for action security_group_members [ 658.979800] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 with Priority: HIGHEST for action security_group_members [ 658.980316] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.980691] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.980691] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.980752] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.980914] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.981804] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.981804] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.981804] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.981804] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.981804] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.065950] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45d4afae-b465-436c-9353-5ec36cb81429 in Status: SUCCESS [ 659.070348] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45d4afae-b465-436c-9353-5ec36cb81429" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.070877] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45d4afae-b465-436c-9353-5ec36cb81429" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.072015] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45d4afae-b465-436c-9353-5ec36cb81429" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.072015] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.072015] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.072015] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.072015] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.072015] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.072015] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45d4afae-b465-436c-9353-5ec36cb81429" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.072015] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('45d4afae-b465-436c-9353-5ec36cb81429',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.105898] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('56c2fe94-2993-4f31-a331-b0611a88cec2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.106073] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-56c2fe94-2993-4f31-a331-b0611a88cec2 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.106151] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.109021] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aba159d0-4f1e-4de2-b3dc-006274ff75b7 with status ACTIVE [ 659.109021] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.109021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.109021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.109021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.109021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.109021] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.109021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.109021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.109021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.109021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.109021] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.109021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.109021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.109021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.109834] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.109834] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aba159d0-4f1e-4de2-b3dc-006274ff75b7 is going to be updated. [ 659.133316] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.133316] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.133316] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.133316] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.133316] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.133316] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aba159d0-4f1e-4de2-b3dc-006274ff75b7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.142159] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c10c686f-5a6b-4af7-9c3e-afe06aedb79b [ 659.142159] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.142159] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.142159] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.142159] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.142159] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.142159] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c10c686f-5a6b-4af7-9c3e-afe06aedb79b already deleted. [ 659.142159] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c10c686f-5a6b-4af7-9c3e-afe06aedb79b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.484577] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.484970] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.484970] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.485113] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.485339] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.485421] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.485825] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.485825] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.485825] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.485825] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.485993] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 is going to be updated. [ 659.518374] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.518374] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.518374] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.518374] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.518374] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.530781] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 in Status: IN_PROGRESS for 2s [ 659.580186] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-45d4afae-b465-436c-9353-5ec36cb81429 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.580186] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45d4afae-b465-436c-9353-5ec36cb81429" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.580186] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45d4afae-b465-436c-9353-5ec36cb81429" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.580186] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45d4afae-b465-436c-9353-5ec36cb81429" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.580186] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.580186] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.580186] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.580186] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.580186] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.580186] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45d4afae-b465-436c-9353-5ec36cb81429" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.580186] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-45d4afae-b465-436c-9353-5ec36cb81429 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.580186] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45d4afae-b465-436c-9353-5ec36cb81429" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.580186] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45d4afae-b465-436c-9353-5ec36cb81429" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.580186] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45d4afae-b465-436c-9353-5ec36cb81429" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.580186] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.580186] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.582023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.582023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.582023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.582023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45d4afae-b465-436c-9353-5ec36cb81429" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.582023] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('45d4afae-b465-436c-9353-5ec36cb81429',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.611403] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('56c2fe94-2993-4f31-a331-b0611a88cec2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.082089] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 45d4afae-b465-436c-9353-5ec36cb81429: rpc.has_security_group_logging(os_id): False [ 660.098810] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.099238] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.099238] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.099363] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.104823] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.105078] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.105513] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.105513] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.105694] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.105784] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.108246] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.108435] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.108552] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.108735] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.108831] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.109083] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.109204] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.109309] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.109403] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.109483] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.109589] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45d4afae-b465-436c-9353-5ec36cb81429 is going to be created. [ 660.116531] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.117702] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.117702] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.117702] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.117702] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.118336] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 is going to be created. [ 660.141249] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.141496] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.141570] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.142468] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.142468] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.151754] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 in Status: UNINITIALIZED for 2s [ 660.190690] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.190926] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.190926] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.191204] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.191340] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.205436] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45d4afae-b465-436c-9353-5ec36cb81429 in Status: IN_PROGRESS for 2s [ 660.940187] env[69506]: INFO networking_nsxv3.common.synchronization [None req-c3d28ba7-cc82-4abe-bcb9-16d34cbefc63 None None] Enqueued Resource ID: 2652f0fe-dbaf-43df-8cb7-c84b203d3cd9 with Priority: HIGHEST for action port [ 660.940442] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2652f0fe-dbaf-43df-8cb7-c84b203d3cd9 with Priority: HIGHEST for action port [ 660.941019] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-2652f0fe-dbaf-43df-8cb7-c84b203d3cd9 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.941153] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2652f0fe-dbaf-43df-8cb7-c84b203d3cd9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.941217] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2652f0fe-dbaf-43df-8cb7-c84b203d3cd9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.941475] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2652f0fe-dbaf-43df-8cb7-c84b203d3cd9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.941561] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2652f0fe-dbaf-43df-8cb7-c84b203d3cd9',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.271622] env[69506]: INFO networking_nsxv3.common.synchronization [None req-8acb6538-f2ff-42e1-9fa2-259fed732dd6 None None] Enqueued Resource ID: ad421824-e392-47cc-8870-219cdb65c533 with Priority: HIGHEST for action port [ 661.272413] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad421824-e392-47cc-8870-219cdb65c533 with Priority: HIGHEST for action port [ 661.272593] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad421824-e392-47cc-8870-219cdb65c533 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.272687] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad421824-e392-47cc-8870-219cdb65c533" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.272802] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad421824-e392-47cc-8870-219cdb65c533" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.273102] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad421824-e392-47cc-8870-219cdb65c533" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.273173] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad421824-e392-47cc-8870-219cdb65c533',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.445720] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2652f0fe-dbaf-43df-8cb7-c84b203d3cd9 [ 661.445720] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.445720] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.445720] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.445720] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.445965] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.445965] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2652f0fe-dbaf-43df-8cb7-c84b203d3cd9 already deleted. [ 661.445965] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2652f0fe-dbaf-43df-8cb7-c84b203d3cd9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.543806] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 in Status: SUCCESS [ 661.544143] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 deletion is rescheduled due to dependency. [ 661.544143] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.776650] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ad421824-e392-47cc-8870-219cdb65c533 [ 661.777367] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.778918] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.778918] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.778918] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.778918] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.778918] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ad421824-e392-47cc-8870-219cdb65c533 already deleted. [ 661.778918] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad421824-e392-47cc-8870-219cdb65c533" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.843585] env[69506]: INFO networking_nsxv3.common.synchronization [req-4242b842-492a-4f14-9dfd-d4df3d07396c req-d2051ad2-5a63-433e-91f1-63e92a1a6f51 tempest-VolumesAssistedSnapshotsTest-664082795 tempest-VolumesAssistedSnapshotsTest-664082795-project-member] Enqueued Resource ID: 66b9350a-2732-4479-ad5a-cb47a49072f7 with Priority: HIGHEST for action security_group_members [ 661.843836] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66b9350a-2732-4479-ad5a-cb47a49072f7 with Priority: HIGHEST for action security_group_members [ 661.844159] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-66b9350a-2732-4479-ad5a-cb47a49072f7 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.844274] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66b9350a-2732-4479-ad5a-cb47a49072f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.844335] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66b9350a-2732-4479-ad5a-cb47a49072f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.844584] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66b9350a-2732-4479-ad5a-cb47a49072f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.844734] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.845519] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.845519] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.847548] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.847548] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.847548] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66b9350a-2732-4479-ad5a-cb47a49072f7',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.161798] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 in Status: SUCCESS [ 662.163381] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.163381] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.163381] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.163381] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.163381] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.163381] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.163922] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.164155] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.164359] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.164563] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('56c2fe94-2993-4f31-a331-b0611a88cec2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.218310] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45d4afae-b465-436c-9353-5ec36cb81429 in Status: SUCCESS [ 662.218310] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45d4afae-b465-436c-9353-5ec36cb81429" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.349804] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.349958] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.350041] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.350261] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.350349] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.351151] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.351468] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.351504] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.351687] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.351771] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.351863] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66b9350a-2732-4479-ad5a-cb47a49072f7 already deleted. [ 662.351969] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66b9350a-2732-4479-ad5a-cb47a49072f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.616591] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-578 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.616794] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-578" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.616898] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-578" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.617226] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-578" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.617514] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.617673] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.617789] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.618017] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.618986] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.619400] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 662.619553] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 662.619736] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 662.619861] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 662.619977] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 662.620149] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 662.620309] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 662.640825] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 662.640825] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 662.640973] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 662.641050] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-578" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.641386] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-80ce2c44-2d47-4772-9f7d-c4ad4213a2fc taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.641643] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-80ce2c44-2d47-4772-9f7d-c4ad4213a2fc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.641714] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-80ce2c44-2d47-4772-9f7d-c4ad4213a2fc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.642214] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-80ce2c44-2d47-4772-9f7d-c4ad4213a2fc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.642296] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80ce2c44-2d47-4772-9f7d-c4ad4213a2fc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.669086] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-56c2fe94-2993-4f31-a331-b0611a88cec2 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.669276] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.670052] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.670052] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.670052] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.670052] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.670261] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.672174] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.672174] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.672174] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.672174] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-56c2fe94-2993-4f31-a331-b0611a88cec2 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.672174] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.672174] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.672174] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.672174] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.672174] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.672174] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.672174] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.672174] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.672174] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.672174] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('56c2fe94-2993-4f31-a331-b0611a88cec2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.871268] env[69506]: INFO networking_nsxv3.common.synchronization [None req-0d20329f-1260-416e-a447-446da8abde19 None None] Enqueued Resource ID: 32e729b9-281e-4950-9479-0bfa1109d488 with Priority: HIGHEST for action port [ 662.871764] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32e729b9-281e-4950-9479-0bfa1109d488 with Priority: HIGHEST for action port [ 662.872061] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-32e729b9-281e-4950-9479-0bfa1109d488 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.872819] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32e729b9-281e-4950-9479-0bfa1109d488" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.872819] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32e729b9-281e-4950-9479-0bfa1109d488" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.872819] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32e729b9-281e-4950-9479-0bfa1109d488" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.872819] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32e729b9-281e-4950-9479-0bfa1109d488',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.145493] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.145493] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.145692] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.145836] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.145979] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.146157] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 80ce2c44-2d47-4772-9f7d-c4ad4213a2fc not found, creating... [ 663.146413] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.146569] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.146569] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.146569] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.146569] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.146569] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.146569] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.146569] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.146569] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.146569] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.146569] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 80ce2c44-2d47-4772-9f7d-c4ad4213a2fc is going to be created. [ 663.170791] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.171117] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.171159] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.171401] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.173088] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.173412] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-80ce2c44-2d47-4772-9f7d-c4ad4213a2fc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.177195] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 56c2fe94-2993-4f31-a331-b0611a88cec2: rpc.has_security_group_logging(os_id): False [ 663.197558] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.197558] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.197558] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.197558] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.197558] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.197558] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.197558] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.197558] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.197558] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.197558] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.197558] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.197558] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.197558] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.197558] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.197558] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.198098] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.198098] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.198098] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.198098] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.198098] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.198098] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 is going to be created. [ 663.259634] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.260969] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.260969] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.260969] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.260969] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.275590] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 in Status: IN_PROGRESS for 2s [ 663.375364] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 32e729b9-281e-4950-9479-0bfa1109d488 [ 663.375596] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.375752] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.375839] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.376120] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.376220] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.376318] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:32e729b9-281e-4950-9479-0bfa1109d488 already deleted. [ 663.376398] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32e729b9-281e-4950-9479-0bfa1109d488" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.300462] env[69506]: INFO networking_nsxv3.common.synchronization [req-4242b842-492a-4f14-9dfd-d4df3d07396c req-ddf5baf1-3c5b-4d46-96dc-ef948f380eb5 service nova] Enqueued Resource ID: 66b9350a-2732-4479-ad5a-cb47a49072f7 with Priority: HIGHEST for action security_group_rules [ 664.300462] env[69506]: INFO networking_nsxv3.common.synchronization [req-4242b842-492a-4f14-9dfd-d4df3d07396c req-ddf5baf1-3c5b-4d46-96dc-ef948f380eb5 service nova] Enqueued Resource ID: 66b9350a-2732-4479-ad5a-cb47a49072f7 with Priority: HIGHEST for action security_group_members [ 664.300462] env[69506]: INFO networking_nsxv3.common.synchronization [req-4242b842-492a-4f14-9dfd-d4df3d07396c req-ddf5baf1-3c5b-4d46-96dc-ef948f380eb5 service nova] Enqueued Resource ID: 80ce2c44-2d47-4772-9f7d-c4ad4213a2fc with Priority: HIGHEST for action port [ 664.300865] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66b9350a-2732-4479-ad5a-cb47a49072f7 with Priority: HIGHEST for action security_group_rules [ 664.300865] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66b9350a-2732-4479-ad5a-cb47a49072f7 with Priority: HIGHEST for action security_group_members [ 664.300865] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80ce2c44-2d47-4772-9f7d-c4ad4213a2fc with Priority: HIGHEST for action port [ 664.302048] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66b9350a-2732-4479-ad5a-cb47a49072f7 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.303218] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66b9350a-2732-4479-ad5a-cb47a49072f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.303218] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66b9350a-2732-4479-ad5a-cb47a49072f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.303218] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66b9350a-2732-4479-ad5a-cb47a49072f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.303218] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66b9350a-2732-4479-ad5a-cb47a49072f7',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.305900] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-66b9350a-2732-4479-ad5a-cb47a49072f7 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.305900] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66b9350a-2732-4479-ad5a-cb47a49072f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.305900] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66b9350a-2732-4479-ad5a-cb47a49072f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.305900] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66b9350a-2732-4479-ad5a-cb47a49072f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.305900] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.305900] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.305900] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.306505] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.306644] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.306958] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66b9350a-2732-4479-ad5a-cb47a49072f7',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.308083] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-80ce2c44-2d47-4772-9f7d-c4ad4213a2fc taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.308083] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-80ce2c44-2d47-4772-9f7d-c4ad4213a2fc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.310565] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-80ce2c44-2d47-4772-9f7d-c4ad4213a2fc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.310565] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-80ce2c44-2d47-4772-9f7d-c4ad4213a2fc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.310565] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80ce2c44-2d47-4772-9f7d-c4ad4213a2fc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.811787] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-66b9350a-2732-4479-ad5a-cb47a49072f7 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.811787] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66b9350a-2732-4479-ad5a-cb47a49072f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.811787] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66b9350a-2732-4479-ad5a-cb47a49072f7',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.812904] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 80ce2c44-2d47-4772-9f7d-c4ad4213a2fc with status ACTIVE [ 664.813119] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.813239] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.813308] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.813747] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.813747] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.813747] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.813898] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.813898] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.814089] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.814168] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.814354] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.814479] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.814512] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.814644] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.814719] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.814804] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 80ce2c44-2d47-4772-9f7d-c4ad4213a2fc is going to be updated. [ 664.836156] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.836312] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.836312] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.837030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.837030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.837030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-80ce2c44-2d47-4772-9f7d-c4ad4213a2fc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.857531] env[69506]: INFO networking_nsxv3.common.synchronization [None req-bb5ddf62-caad-4741-b3b7-ac50ce6a2b42 None None] Enqueued Resource ID: 826e0761-fb11-4b5f-98d6-5087e0f8e9f4 with Priority: HIGHEST for action port [ 664.857792] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826e0761-fb11-4b5f-98d6-5087e0f8e9f4 with Priority: HIGHEST for action port [ 664.858407] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-826e0761-fb11-4b5f-98d6-5087e0f8e9f4 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.859420] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-826e0761-fb11-4b5f-98d6-5087e0f8e9f4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.859420] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-826e0761-fb11-4b5f-98d6-5087e0f8e9f4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.859420] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-826e0761-fb11-4b5f-98d6-5087e0f8e9f4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.859420] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('826e0761-fb11-4b5f-98d6-5087e0f8e9f4',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.169211] env[69506]: INFO networking_nsxv3.common.synchronization [req-71672351-dc07-43ae-8760-2070294eb178 req-2c1e88ce-217d-4c9e-adcd-d8039e526af6 tempest-SecurityGroupRulesTestJSON-2004689177 tempest-SecurityGroupRulesTestJSON-2004689177-project-member] Enqueued Resource ID: 52dc84a3-2127-4b4a-84e6-ed7bf2cfc360 with Priority: HIGHEST for action security_group_rules [ 665.169211] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52dc84a3-2127-4b4a-84e6-ed7bf2cfc360 with Priority: HIGHEST for action security_group_rules [ 665.172133] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52dc84a3-2127-4b4a-84e6-ed7bf2cfc360 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.172716] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52dc84a3-2127-4b4a-84e6-ed7bf2cfc360" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.172867] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52dc84a3-2127-4b4a-84e6-ed7bf2cfc360" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.173238] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52dc84a3-2127-4b4a-84e6-ed7bf2cfc360" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.173441] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52dc84a3-2127-4b4a-84e6-ed7bf2cfc360',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.285855] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 in Status: SUCCESS [ 665.286701] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.313914] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66b9350a-2732-4479-ad5a-cb47a49072f7',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.361695] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 826e0761-fb11-4b5f-98d6-5087e0f8e9f4 [ 665.361908] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.362472] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.362472] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.362472] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.362472] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.362681] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:826e0761-fb11-4b5f-98d6-5087e0f8e9f4 already deleted. [ 665.362681] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-826e0761-fb11-4b5f-98d6-5087e0f8e9f4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.449390] env[69506]: INFO networking_nsxv3.common.synchronization [req-d3913ea8-4dbe-480c-9b14-40af2dc26f8a req-339067ae-3ff5-4fbe-90f7-7c81945465ee tempest-TenantUsagesTestJSON-1481649972 tempest-TenantUsagesTestJSON-1481649972-project-member] Enqueued Resource ID: 9ce980c1-0c92-48ab-930f-2537a5f82269 with Priority: HIGHEST for action security_group_members [ 665.449938] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ce980c1-0c92-48ab-930f-2537a5f82269 with Priority: HIGHEST for action security_group_members [ 665.450256] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ce980c1-0c92-48ab-930f-2537a5f82269 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.450387] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ce980c1-0c92-48ab-930f-2537a5f82269" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.450449] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ce980c1-0c92-48ab-930f-2537a5f82269" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.452288] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ce980c1-0c92-48ab-930f-2537a5f82269" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.452288] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.452463] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.452463] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.453767] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.453767] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.453767] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ce980c1-0c92-48ab-930f-2537a5f82269',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.699977] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.700446] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.700628] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.701433] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.701433] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.701433] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52dc84a3-2127-4b4a-84e6-ed7bf2cfc360 already deleted. [ 665.701433] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52dc84a3-2127-4b4a-84e6-ed7bf2cfc360" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.819981] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.821043] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.821043] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.821043] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.821043] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.821270] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66b9350a-2732-4479-ad5a-cb47a49072f7 is going to be created. [ 665.849612] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.849785] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.849856] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.850096] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.850274] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.866246] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66b9350a-2732-4479-ad5a-cb47a49072f7 in Status: UNINITIALIZED for 2s [ 665.957031] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.957221] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.957782] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.958555] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.958704] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.958949] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.959087] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.959154] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.959338] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.959437] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.960395] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ce980c1-0c92-48ab-930f-2537a5f82269 is going to be updated. [ 665.992049] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.992049] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.992049] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.992049] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.992049] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.000734] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ce980c1-0c92-48ab-930f-2537a5f82269 in Status: IN_PROGRESS for 2s [ 666.126119] env[69506]: INFO networking_nsxv3.common.synchronization [None req-d147e82d-822f-4aef-85a2-39c78a87bab6 None None] Enqueued Resource ID: 48715800-eaf0-43ff-9ae8-64fefb0f3e51 with Priority: HIGHEST for action port [ 666.126804] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48715800-eaf0-43ff-9ae8-64fefb0f3e51 with Priority: HIGHEST for action port [ 666.128772] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-48715800-eaf0-43ff-9ae8-64fefb0f3e51 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.128772] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48715800-eaf0-43ff-9ae8-64fefb0f3e51" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.128932] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48715800-eaf0-43ff-9ae8-64fefb0f3e51" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.129101] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48715800-eaf0-43ff-9ae8-64fefb0f3e51" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.129185] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48715800-eaf0-43ff-9ae8-64fefb0f3e51',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.631409] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 48715800-eaf0-43ff-9ae8-64fefb0f3e51 [ 666.631713] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.631794] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.631883] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.632093] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.632182] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.632291] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:48715800-eaf0-43ff-9ae8-64fefb0f3e51 already deleted. [ 666.632365] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48715800-eaf0-43ff-9ae8-64fefb0f3e51" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.198449] env[69506]: INFO networking_nsxv3.common.synchronization [req-a519c88f-cc47-4bdf-a420-7b75dd78b7c1 req-d4228b7c-d947-45a0-9a80-bf0c733d16a6 tempest-ListServerFiltersTestJSON-2708404 tempest-ListServerFiltersTestJSON-2708404-project-member] Enqueued Resource ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d with Priority: HIGHEST for action security_group_members [ 667.198988] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d with Priority: HIGHEST for action security_group_members [ 667.199560] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-823c6679-501c-4ec2-9d9f-f49b7cc1205d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.199560] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.199560] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.199827] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.199988] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.200110] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.200188] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.200345] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.200445] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.200551] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('823c6679-501c-4ec2-9d9f-f49b7cc1205d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.485069] env[69506]: INFO networking_nsxv3.common.synchronization [None req-1ecd990f-0bda-4bbb-a701-de856b62671e None None] Enqueued Resource ID: 31b903d9-000b-49ce-b517-42ce00b8f626 with Priority: HIGHEST for action port [ 667.485621] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31b903d9-000b-49ce-b517-42ce00b8f626 with Priority: HIGHEST for action port [ 667.486294] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-31b903d9-000b-49ce-b517-42ce00b8f626 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.486479] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31b903d9-000b-49ce-b517-42ce00b8f626" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.486479] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31b903d9-000b-49ce-b517-42ce00b8f626" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.486796] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31b903d9-000b-49ce-b517-42ce00b8f626" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.486885] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31b903d9-000b-49ce-b517-42ce00b8f626',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.703187] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.703494] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.703604] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.703959] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.704144] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.704465] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.704890] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.704890] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.705090] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.705090] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.705187] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d already deleted. [ 667.705296] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.877678] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66b9350a-2732-4479-ad5a-cb47a49072f7 in Status: SUCCESS [ 667.877678] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66b9350a-2732-4479-ad5a-cb47a49072f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.877678] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66b9350a-2732-4479-ad5a-cb47a49072f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.877678] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66b9350a-2732-4479-ad5a-cb47a49072f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.877678] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.877982] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.877982] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.878098] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.878145] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.878229] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66b9350a-2732-4479-ad5a-cb47a49072f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.878318] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66b9350a-2732-4479-ad5a-cb47a49072f7',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.989269] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31b903d9-000b-49ce-b517-42ce00b8f626 [ 667.989508] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.989647] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.989712] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.989934] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.990036] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.990131] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31b903d9-000b-49ce-b517-42ce00b8f626 already deleted. [ 667.990215] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31b903d9-000b-49ce-b517-42ce00b8f626" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.011037] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ce980c1-0c92-48ab-930f-2537a5f82269 in Status: SUCCESS [ 668.011037] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ce980c1-0c92-48ab-930f-2537a5f82269 deletion is rescheduled due to dependency. [ 668.011037] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ce980c1-0c92-48ab-930f-2537a5f82269" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.103084] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-167 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.103313] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-167" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.103443] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-167" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.105452] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-167" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.106594] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.107278] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.108239] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.109411] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.110024] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.110338] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 668.110526] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 668.110671] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 668.110832] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 668.111530] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 668.111530] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 668.111530] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 668.129893] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 668.129893] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 668.129893] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 668.129893] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-167" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.129893] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-3055311e-4ec7-4c71-af7b-6dd1d248b090 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.129893] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-3055311e-4ec7-4c71-af7b-6dd1d248b090" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.130420] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-3055311e-4ec7-4c71-af7b-6dd1d248b090" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.130420] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-3055311e-4ec7-4c71-af7b-6dd1d248b090" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.130628] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3055311e-4ec7-4c71-af7b-6dd1d248b090',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.382633] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66b9350a-2732-4479-ad5a-cb47a49072f7',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.500983] env[69506]: INFO networking_nsxv3.common.synchronization [None req-71c97fea-55b1-4e2d-9fbb-76b8d11a2cea None None] Enqueued Resource ID: c5133464-7e7e-4763-936a-9ed6128aeff5 with Priority: HIGHEST for action port [ 668.501293] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5133464-7e7e-4763-936a-9ed6128aeff5 with Priority: HIGHEST for action port [ 668.501880] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5133464-7e7e-4763-936a-9ed6128aeff5 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.502025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5133464-7e7e-4763-936a-9ed6128aeff5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.504942] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5133464-7e7e-4763-936a-9ed6128aeff5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.505649] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5133464-7e7e-4763-936a-9ed6128aeff5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.505649] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5133464-7e7e-4763-936a-9ed6128aeff5',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.634859] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.635102] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.635249] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.635641] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.635956] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.635956] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 3055311e-4ec7-4c71-af7b-6dd1d248b090 not found, creating... [ 668.636221] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.636385] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.636630] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.636719] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.636855] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.637244] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.637566] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.637680] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.637833] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.637985] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.638157] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 3055311e-4ec7-4c71-af7b-6dd1d248b090 is going to be created. [ 668.658804] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.658804] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.658804] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.658804] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.659084] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.659427] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-3055311e-4ec7-4c71-af7b-6dd1d248b090" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.885050] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66b9350a-2732-4479-ad5a-cb47a49072f7: rpc.has_security_group_logging(os_id): False [ 668.902223] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.902378] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.902438] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.902658] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.902748] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.903112] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.903112] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.903268] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.903309] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.903404] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.903516] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66b9350a-2732-4479-ad5a-cb47a49072f7 is going to be created. [ 668.959738] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.959895] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.959968] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.960188] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.960363] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.972305] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66b9350a-2732-4479-ad5a-cb47a49072f7 in Status: IN_PROGRESS for 2s [ 669.008450] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c5133464-7e7e-4763-936a-9ed6128aeff5 [ 669.009102] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.009102] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.009102] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.009102] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.009296] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.009296] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c5133464-7e7e-4763-936a-9ed6128aeff5 already deleted. [ 669.009400] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5133464-7e7e-4763-936a-9ed6128aeff5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.383298] env[69506]: INFO networking_nsxv3.common.synchronization [req-164a6b36-fb34-4fc7-944a-c697ee4b722f req-5bb7bf2b-16bb-4a8c-b8ec-3b11bbc2beb1 tempest-ServersWithSpecificFlavorTestJSON-989278643 tempest-ServersWithSpecificFlavorTestJSON-989278643-project-member] Enqueued Resource ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 with Priority: HIGHEST for action security_group_members [ 669.383298] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 with Priority: HIGHEST for action security_group_members [ 669.383298] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6908af9-f839-40b2-9ca2-1fd554ee1d78 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.383298] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.387685] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.387685] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.387685] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.387685] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.387685] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.387685] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.387685] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.387685] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6908af9-f839-40b2-9ca2-1fd554ee1d78',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.893588] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.893897] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.893897] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.894284] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.894284] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.894401] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.894457] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.894495] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.894622] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.894707] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.894813] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 already deleted. [ 669.894907] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.980844] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-795 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.981140] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-795" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.981210] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-795" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.981510] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-795" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.981764] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.981922] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.982046] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.982264] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.982409] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.982653] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 669.982773] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 669.982880] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 669.982988] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 669.983265] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 669.983265] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 669.983381] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 670.002993] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 670.003168] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 670.003309] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 670.003504] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-795" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.004028] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-cf54f0c5-a5fb-42d7-a82e-dea752da33e4 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.004252] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-cf54f0c5-a5fb-42d7-a82e-dea752da33e4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.004377] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-cf54f0c5-a5fb-42d7-a82e-dea752da33e4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.004695] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-cf54f0c5-a5fb-42d7-a82e-dea752da33e4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.004930] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf54f0c5-a5fb-42d7-a82e-dea752da33e4',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.507014] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.507284] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.507501] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.507726] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.507860] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.508120] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port cf54f0c5-a5fb-42d7-a82e-dea752da33e4 not found, creating... [ 670.508308] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.508508] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.508625] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.508843] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.508975] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.509270] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.509472] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.509546] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.509761] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.510183] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.510183] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: cf54f0c5-a5fb-42d7-a82e-dea752da33e4 is going to be created. [ 670.533605] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.533825] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.534219] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.534219] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.534427] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.534612] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-cf54f0c5-a5fb-42d7-a82e-dea752da33e4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.568927] env[69506]: INFO networking_nsxv3.common.synchronization [req-a519c88f-cc47-4bdf-a420-7b75dd78b7c1 req-58df24d4-8d06-401d-bb8e-589f2c9887e4 service nova] Enqueued Resource ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d with Priority: HIGHEST for action security_group_rules [ 670.569150] env[69506]: INFO networking_nsxv3.common.synchronization [req-a519c88f-cc47-4bdf-a420-7b75dd78b7c1 req-58df24d4-8d06-401d-bb8e-589f2c9887e4 service nova] Enqueued Resource ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d with Priority: HIGHEST for action security_group_members [ 670.569348] env[69506]: INFO networking_nsxv3.common.synchronization [req-a519c88f-cc47-4bdf-a420-7b75dd78b7c1 req-58df24d4-8d06-401d-bb8e-589f2c9887e4 service nova] Enqueued Resource ID: 3055311e-4ec7-4c71-af7b-6dd1d248b090 with Priority: HIGHEST for action port [ 670.569743] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d with Priority: HIGHEST for action security_group_rules [ 670.569906] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d with Priority: HIGHEST for action security_group_members [ 670.570096] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3055311e-4ec7-4c71-af7b-6dd1d248b090 with Priority: HIGHEST for action port [ 670.570780] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-823c6679-501c-4ec2-9d9f-f49b7cc1205d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.570929] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.571133] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.571428] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.571542] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('823c6679-501c-4ec2-9d9f-f49b7cc1205d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.572442] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-823c6679-501c-4ec2-9d9f-f49b7cc1205d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.572560] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.572628] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.572804] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.572950] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.573055] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.573117] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.573263] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.573346] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.573437] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('823c6679-501c-4ec2-9d9f-f49b7cc1205d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.574812] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-3055311e-4ec7-4c71-af7b-6dd1d248b090 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.574812] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3055311e-4ec7-4c71-af7b-6dd1d248b090" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.574812] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3055311e-4ec7-4c71-af7b-6dd1d248b090" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.575032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3055311e-4ec7-4c71-af7b-6dd1d248b090" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.575099] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3055311e-4ec7-4c71-af7b-6dd1d248b090',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.642066] env[69506]: INFO networking_nsxv3.common.synchronization [req-59cf13a1-352a-4feb-a51f-9f33e93114d4 req-6be981b1-7330-45f6-a647-4a28af4cb5c5 tempest-SecurityGroupRulesNegativeTestJSON-968036756 tempest-SecurityGroupRulesNegativeTestJSON-968036756-project-member] Enqueued Resource ID: 58948433-a938-49a9-8aa7-8d4583ceff36 with Priority: HIGHEST for action security_group_rules [ 670.642066] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58948433-a938-49a9-8aa7-8d4583ceff36 with Priority: HIGHEST for action security_group_rules [ 670.642066] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58948433-a938-49a9-8aa7-8d4583ceff36 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.642066] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58948433-a938-49a9-8aa7-8d4583ceff36" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.642066] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58948433-a938-49a9-8aa7-8d4583ceff36" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.642846] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58948433-a938-49a9-8aa7-8d4583ceff36" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.644071] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58948433-a938-49a9-8aa7-8d4583ceff36',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.984597] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66b9350a-2732-4479-ad5a-cb47a49072f7 in Status: SUCCESS [ 670.984597] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66b9350a-2732-4479-ad5a-cb47a49072f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.077199] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('823c6679-501c-4ec2-9d9f-f49b7cc1205d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.078634] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-823c6679-501c-4ec2-9d9f-f49b7cc1205d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.078803] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.080987] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3055311e-4ec7-4c71-af7b-6dd1d248b090 with status ACTIVE [ 671.081241] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.081356] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.081356] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.081633] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.082170] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.082170] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.082292] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.082413] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.082556] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.082597] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.082744] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.082843] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.082906] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.083090] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.083161] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.083247] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3055311e-4ec7-4c71-af7b-6dd1d248b090 is going to be updated. [ 671.108690] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.108862] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.108935] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.109285] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.109285] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.110234] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3055311e-4ec7-4c71-af7b-6dd1d248b090" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.194267] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.194476] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.194476] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.195037] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.195037] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.195037] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58948433-a938-49a9-8aa7-8d4583ceff36 already deleted. [ 671.195037] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58948433-a938-49a9-8aa7-8d4583ceff36" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.579672] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('823c6679-501c-4ec2-9d9f-f49b7cc1205d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.596106] env[69506]: INFO networking_nsxv3.common.synchronization [None req-a1d83df5-73a6-4340-aac4-ce1f421e4dba None None] Enqueued Resource ID: 3c47a99f-52f1-4bf2-a218-45237600f8a4 with Priority: HIGHEST for action port [ 671.597878] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c47a99f-52f1-4bf2-a218-45237600f8a4 with Priority: HIGHEST for action port [ 671.599546] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c47a99f-52f1-4bf2-a218-45237600f8a4 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.599718] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c47a99f-52f1-4bf2-a218-45237600f8a4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.599855] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c47a99f-52f1-4bf2-a218-45237600f8a4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.600343] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c47a99f-52f1-4bf2-a218-45237600f8a4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.600470] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c47a99f-52f1-4bf2-a218-45237600f8a4',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.642031] env[69506]: INFO networking_nsxv3.common.synchronization [None req-e43f559a-7b9d-4176-b2ff-23e935c591cc None None] Enqueued Resource ID: 3b390b49-2dbe-42bb-b409-0478c03e1ac0 with Priority: HIGHEST for action port [ 671.643017] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b390b49-2dbe-42bb-b409-0478c03e1ac0 with Priority: HIGHEST for action port [ 671.644094] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b390b49-2dbe-42bb-b409-0478c03e1ac0 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.644364] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b390b49-2dbe-42bb-b409-0478c03e1ac0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.644502] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b390b49-2dbe-42bb-b409-0478c03e1ac0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.644912] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b390b49-2dbe-42bb-b409-0478c03e1ac0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.645320] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b390b49-2dbe-42bb-b409-0478c03e1ac0',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.763552] env[69506]: INFO networking_nsxv3.common.synchronization [req-164a6b36-fb34-4fc7-944a-c697ee4b722f req-20a500b8-91de-4edf-b1cd-b606a3ab1e3f service nova] Enqueued Resource ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 with Priority: HIGHEST for action security_group_rules [ 671.763713] env[69506]: INFO networking_nsxv3.common.synchronization [req-164a6b36-fb34-4fc7-944a-c697ee4b722f req-20a500b8-91de-4edf-b1cd-b606a3ab1e3f service nova] Enqueued Resource ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 with Priority: HIGHEST for action security_group_members [ 671.763848] env[69506]: INFO networking_nsxv3.common.synchronization [req-164a6b36-fb34-4fc7-944a-c697ee4b722f req-20a500b8-91de-4edf-b1cd-b606a3ab1e3f service nova] Enqueued Resource ID: cf54f0c5-a5fb-42d7-a82e-dea752da33e4 with Priority: HIGHEST for action port [ 671.764097] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 with Priority: HIGHEST for action security_group_rules [ 671.764226] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 with Priority: HIGHEST for action security_group_members [ 671.764320] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf54f0c5-a5fb-42d7-a82e-dea752da33e4 with Priority: HIGHEST for action port [ 671.764978] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6908af9-f839-40b2-9ca2-1fd554ee1d78 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.765098] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.765184] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.765405] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.765485] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6908af9-f839-40b2-9ca2-1fd554ee1d78',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.768465] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6908af9-f839-40b2-9ca2-1fd554ee1d78 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.768465] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.768465] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.768465] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.768465] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.768465] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.768465] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.768465] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.768465] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.768465] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6908af9-f839-40b2-9ca2-1fd554ee1d78',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.773208] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf54f0c5-a5fb-42d7-a82e-dea752da33e4 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.773208] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf54f0c5-a5fb-42d7-a82e-dea752da33e4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.773208] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf54f0c5-a5fb-42d7-a82e-dea752da33e4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.773208] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf54f0c5-a5fb-42d7-a82e-dea752da33e4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.773208] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf54f0c5-a5fb-42d7-a82e-dea752da33e4',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.004404] env[69506]: INFO networking_nsxv3.common.synchronization [req-d7c00714-695a-4a07-bf57-01ba762cb6db req-25d12ba8-f1dc-4183-a47d-908060070f98 tempest-SecurityGroupRulesTestJSON-2004689177 tempest-SecurityGroupRulesTestJSON-2004689177-project-member] Enqueued Resource ID: 2bf60b06-9da8-4229-9805-32503a9a1e15 with Priority: HIGHEST for action security_group_rules [ 672.006338] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bf60b06-9da8-4229-9805-32503a9a1e15 with Priority: HIGHEST for action security_group_rules [ 672.006955] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2bf60b06-9da8-4229-9805-32503a9a1e15 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.007246] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2bf60b06-9da8-4229-9805-32503a9a1e15" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.007500] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2bf60b06-9da8-4229-9805-32503a9a1e15" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.007914] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2bf60b06-9da8-4229-9805-32503a9a1e15" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.008182] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2bf60b06-9da8-4229-9805-32503a9a1e15',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.114721] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.114721] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.114721] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.114721] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.114721] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.114721] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d is going to be created. [ 672.114721] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3c47a99f-52f1-4bf2-a218-45237600f8a4 [ 672.114721] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.114721] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.114721] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.114721] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.114721] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.114721] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3c47a99f-52f1-4bf2-a218-45237600f8a4 already deleted. [ 672.114721] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c47a99f-52f1-4bf2-a218-45237600f8a4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.114721] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.114721] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.116516] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.116516] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.116516] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.122935] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d in Status: UNINITIALIZED for 2s [ 672.148428] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3b390b49-2dbe-42bb-b409-0478c03e1ac0 [ 672.148697] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.148841] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.149038] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.149159] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.149252] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.149990] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3b390b49-2dbe-42bb-b409-0478c03e1ac0 already deleted. [ 672.149990] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b390b49-2dbe-42bb-b409-0478c03e1ac0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.270495] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6908af9-f839-40b2-9ca2-1fd554ee1d78',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.271426] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cf54f0c5-a5fb-42d7-a82e-dea752da33e4 with status ACTIVE [ 672.271668] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.271811] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.271845] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.272032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.272148] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.272316] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.272463] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.272463] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.272610] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.272859] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.272930] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.273103] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.273155] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.273261] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.273324] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.273409] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cf54f0c5-a5fb-42d7-a82e-dea752da33e4 is going to be updated. [ 672.275066] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6908af9-f839-40b2-9ca2-1fd554ee1d78 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.275066] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.293961] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.294239] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.294239] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.295596] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.296850] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.296892] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf54f0c5-a5fb-42d7-a82e-dea752da33e4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.461042] env[69506]: INFO networking_nsxv3.common.synchronization [req-2934b3da-aa39-4db3-85f5-ffc70c667bb3 req-f320b24d-b189-4c80-977e-561b5b255891 tempest-ListServerFiltersTestJSON-2708404 tempest-ListServerFiltersTestJSON-2708404-project-member] Enqueued Resource ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d with Priority: HIGHEST for action security_group_members [ 672.461584] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d with Priority: HIGHEST for action security_group_members [ 672.461954] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-823c6679-501c-4ec2-9d9f-f49b7cc1205d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.462053] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.529249] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.529340] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.529340] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.529581] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.529750] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.529883] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2bf60b06-9da8-4229-9805-32503a9a1e15 already deleted. [ 672.529977] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2bf60b06-9da8-4229-9805-32503a9a1e15" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.777164] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6908af9-f839-40b2-9ca2-1fd554ee1d78',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.120056] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-167 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.120356] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-167" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.120396] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-167" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.120716] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-167" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.120893] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.125115] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.125681] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.125681] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.125804] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.126083] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 673.126241] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 673.126383] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 673.126849] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 673.126849] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 673.126849] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 673.126988] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 673.144759] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 673.144918] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 673.145075] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 673.145258] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-167" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.145631] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-be0db92b-c3b0-432a-b17a-87a3b62ef694 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.145816] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-be0db92b-c3b0-432a-b17a-87a3b62ef694" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.145941] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-be0db92b-c3b0-432a-b17a-87a3b62ef694" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.146291] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-be0db92b-c3b0-432a-b17a-87a3b62ef694" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.146609] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be0db92b-c3b0-432a-b17a-87a3b62ef694',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.285965] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.285965] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.285965] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.285965] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.285965] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.285965] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 is going to be created. [ 673.315720] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.317791] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.317791] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.317791] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.317791] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.325488] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 in Status: UNINITIALIZED for 2s [ 673.434914] env[69506]: INFO networking_nsxv3.common.synchronization [req-63b88e95-bc59-4c69-ae79-8779b6ad1311 req-e4a87558-edde-48eb-883d-1e77dd45d7c6 tempest-ServerDiagnosticsNegativeTest-931616368 tempest-ServerDiagnosticsNegativeTest-931616368-project-member] Enqueued Resource ID: 45d4afae-b465-436c-9353-5ec36cb81429 with Priority: HIGHEST for action security_group_members [ 673.435447] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45d4afae-b465-436c-9353-5ec36cb81429 with Priority: HIGHEST for action security_group_members [ 673.435683] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-45d4afae-b465-436c-9353-5ec36cb81429 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.436581] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45d4afae-b465-436c-9353-5ec36cb81429" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.436718] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45d4afae-b465-436c-9353-5ec36cb81429" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.436908] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45d4afae-b465-436c-9353-5ec36cb81429" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.437127] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.437256] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.437334] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.437539] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.437663] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.437756] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45d4afae-b465-436c-9353-5ec36cb81429',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.651300] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.651649] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.651649] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.651933] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.652096] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.652767] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port be0db92b-c3b0-432a-b17a-87a3b62ef694 not found, creating... [ 673.652767] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.652767] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.652767] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.653084] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.653135] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.653392] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.654027] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.654027] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.654027] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.654027] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.654284] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: be0db92b-c3b0-432a-b17a-87a3b62ef694 is going to be created. [ 673.674753] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.674867] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.675055] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.675306] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.676548] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.676548] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-be0db92b-c3b0-432a-b17a-87a3b62ef694" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.773280] env[69506]: INFO networking_nsxv3.common.synchronization [req-bb5d00e3-6e13-42dc-bdda-0c20aaa88980 req-607499d4-d2cb-4341-bb66-0bec5d2a17ec tempest-SecurityGroupRulesNegativeTestJSON-968036756 tempest-SecurityGroupRulesNegativeTestJSON-968036756-project-member] Enqueued Resource ID: 58948433-a938-49a9-8aa7-8d4583ceff36 with Priority: HIGHEST for action security_group_rules [ 673.773579] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58948433-a938-49a9-8aa7-8d4583ceff36 with Priority: HIGHEST for action security_group_rules [ 673.773945] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58948433-a938-49a9-8aa7-8d4583ceff36 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.774086] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58948433-a938-49a9-8aa7-8d4583ceff36" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.774168] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58948433-a938-49a9-8aa7-8d4583ceff36" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.774415] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58948433-a938-49a9-8aa7-8d4583ceff36" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.774510] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58948433-a938-49a9-8aa7-8d4583ceff36',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.940539] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.940726] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.940793] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.941017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.941154] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.941308] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.941405] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.941464] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.941649] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.941726] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.941925] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45d4afae-b465-436c-9353-5ec36cb81429 is going to be updated. [ 673.968867] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.969044] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.969104] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.969317] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.969451] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.981939] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45d4afae-b465-436c-9353-5ec36cb81429 in Status: IN_PROGRESS for 2s [ 674.134467] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d in Status: UNINITIALIZED for 4s [ 674.296413] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.296611] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.296670] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.296899] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.297026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.297589] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58948433-a938-49a9-8aa7-8d4583ceff36 already deleted. [ 674.297697] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58948433-a938-49a9-8aa7-8d4583ceff36" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.341406] env[69506]: INFO networking_nsxv3.common.synchronization [None req-1ceeeb83-81cd-4955-9f43-c7a8ea407662 None None] Enqueued Resource ID: 6b7ac121-33d4-48c1-914f-3ab09347b370 with Priority: HIGHEST for action port [ 674.341406] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b7ac121-33d4-48c1-914f-3ab09347b370 with Priority: HIGHEST for action port [ 674.341719] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b7ac121-33d4-48c1-914f-3ab09347b370 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.341719] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b7ac121-33d4-48c1-914f-3ab09347b370" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.341719] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b7ac121-33d4-48c1-914f-3ab09347b370" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.343528] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b7ac121-33d4-48c1-914f-3ab09347b370" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.343621] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b7ac121-33d4-48c1-914f-3ab09347b370',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.357691] env[69506]: INFO networking_nsxv3.common.synchronization [None req-b523cae8-82fe-49d0-bf97-ae932654d634 None None] Enqueued Resource ID: 352a3b6f-b391-4bbf-af46-ee2578e57696 with Priority: HIGHEST for action port [ 674.357921] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 352a3b6f-b391-4bbf-af46-ee2578e57696 with Priority: HIGHEST for action port [ 674.358482] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-352a3b6f-b391-4bbf-af46-ee2578e57696 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.358589] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-352a3b6f-b391-4bbf-af46-ee2578e57696" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.358697] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-352a3b6f-b391-4bbf-af46-ee2578e57696" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.358901] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-352a3b6f-b391-4bbf-af46-ee2578e57696" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.358980] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('352a3b6f-b391-4bbf-af46-ee2578e57696',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.846536] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6b7ac121-33d4-48c1-914f-3ab09347b370 [ 674.846536] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.846536] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.846536] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.846536] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.846839] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.846839] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6b7ac121-33d4-48c1-914f-3ab09347b370 already deleted. [ 674.846839] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b7ac121-33d4-48c1-914f-3ab09347b370" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.861240] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 352a3b6f-b391-4bbf-af46-ee2578e57696 [ 674.861496] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.861646] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.861712] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.862569] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.862569] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.862569] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:352a3b6f-b391-4bbf-af46-ee2578e57696 already deleted. [ 674.862569] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-352a3b6f-b391-4bbf-af46-ee2578e57696" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.876372] env[69506]: INFO networking_nsxv3.common.synchronization [req-2934b3da-aa39-4db3-85f5-ffc70c667bb3 req-7d2dbfea-4ac4-4db6-affb-ad67e12d2eaa service nova] Enqueued Resource ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d with Priority: HIGHEST for action security_group_rules [ 674.876617] env[69506]: INFO networking_nsxv3.common.synchronization [req-2934b3da-aa39-4db3-85f5-ffc70c667bb3 req-7d2dbfea-4ac4-4db6-affb-ad67e12d2eaa service nova] Enqueued Resource ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d with Priority: HIGHEST for action security_group_members [ 674.876734] env[69506]: INFO networking_nsxv3.common.synchronization [req-2934b3da-aa39-4db3-85f5-ffc70c667bb3 req-7d2dbfea-4ac4-4db6-affb-ad67e12d2eaa service nova] Enqueued Resource ID: be0db92b-c3b0-432a-b17a-87a3b62ef694 with Priority: HIGHEST for action port [ 674.878073] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d with Priority: HIGHEST for action security_group_rules [ 674.878073] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d with Priority: HIGHEST for action security_group_members [ 674.878073] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be0db92b-c3b0-432a-b17a-87a3b62ef694 with Priority: HIGHEST for action port [ 674.878073] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-823c6679-501c-4ec2-9d9f-f49b7cc1205d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.878073] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.878073] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-823c6679-501c-4ec2-9d9f-f49b7cc1205d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.878571] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.878868] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-be0db92b-c3b0-432a-b17a-87a3b62ef694 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.878939] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be0db92b-c3b0-432a-b17a-87a3b62ef694" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.878981] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be0db92b-c3b0-432a-b17a-87a3b62ef694" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.879184] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be0db92b-c3b0-432a-b17a-87a3b62ef694" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.879575] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be0db92b-c3b0-432a-b17a-87a3b62ef694',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.336963] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 in Status: SUCCESS [ 675.337332] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.337442] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.337671] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.337895] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.338037] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.338112] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.338267] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.338353] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.338445] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.338560] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a6908af9-f839-40b2-9ca2-1fd554ee1d78',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.383943] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port be0db92b-c3b0-432a-b17a-87a3b62ef694 with status ACTIVE [ 675.384202] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.384341] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.384406] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.384659] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.384748] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.384950] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.385066] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.385128] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.385995] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.385995] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.385995] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.386559] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.386654] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.386826] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.386930] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.387047] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: be0db92b-c3b0-432a-b17a-87a3b62ef694 is going to be updated. [ 675.412115] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.412115] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.412115] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.412115] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.412115] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.412115] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be0db92b-c3b0-432a-b17a-87a3b62ef694" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.845506] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a6908af9-f839-40b2-9ca2-1fd554ee1d78',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.992948] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45d4afae-b465-436c-9353-5ec36cb81429 in Status: SUCCESS [ 675.993150] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45d4afae-b465-436c-9353-5ec36cb81429 deletion is rescheduled due to dependency. [ 675.993268] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45d4afae-b465-436c-9353-5ec36cb81429" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.143882] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d in Status: SUCCESS [ 676.145107] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.145107] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.145107] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.145107] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.145107] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.145107] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.145107] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.145107] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.145107] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.145579] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('823c6679-501c-4ec2-9d9f-f49b7cc1205d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.146010] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.146228] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.146389] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.146497] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.146555] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.146715] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.147155] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.147155] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('823c6679-501c-4ec2-9d9f-f49b7cc1205d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.348922] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a6908af9-f839-40b2-9ca2-1fd554ee1d78: rpc.has_security_group_logging(os_id): False [ 676.365470] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.365686] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.365790] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.366087] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.366229] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.366536] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.366686] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.366800] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.366996] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.367136] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.367272] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 is going to be created. [ 676.423355] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.423563] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.423599] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.423867] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.424099] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.436067] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 in Status: IN_PROGRESS for 2s [ 676.650038] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-823c6679-501c-4ec2-9d9f-f49b7cc1205d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.650038] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.650038] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('823c6679-501c-4ec2-9d9f-f49b7cc1205d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.843170] env[69506]: INFO networking_nsxv3.common.synchronization [req-0c40d38f-49c8-4241-9cb1-123f003bba1e req-0f3a9b5b-b34d-4ae4-bf08-799869458f1d tempest-SecurityGroupRulesTestJSON-2004689177 tempest-SecurityGroupRulesTestJSON-2004689177-project-member] Enqueued Resource ID: bc24f0ac-dc61-42ba-a959-96164f8b9055 with Priority: HIGHEST for action security_group_rules [ 676.843724] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc24f0ac-dc61-42ba-a959-96164f8b9055 with Priority: HIGHEST for action security_group_rules [ 676.846242] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc24f0ac-dc61-42ba-a959-96164f8b9055 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.846242] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc24f0ac-dc61-42ba-a959-96164f8b9055" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.846242] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc24f0ac-dc61-42ba-a959-96164f8b9055" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.846688] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc24f0ac-dc61-42ba-a959-96164f8b9055" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.846688] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc24f0ac-dc61-42ba-a959-96164f8b9055',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.154489] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('823c6679-501c-4ec2-9d9f-f49b7cc1205d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.368823] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.368823] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.368823] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.368823] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.368823] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.368823] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc24f0ac-dc61-42ba-a959-96164f8b9055 already deleted. [ 677.368823] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc24f0ac-dc61-42ba-a959-96164f8b9055" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.657120] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.657290] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.657361] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.657800] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.658289] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.658289] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d is going to be updated. [ 677.686768] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.686983] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.687051] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.687272] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.687407] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.695602] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d in Status: IN_PROGRESS for 2s [ 677.810443] env[69506]: INFO networking_nsxv3.common.synchronization [req-791057d2-5a3b-4f4d-bcd5-dd58c26bba6f req-d6562eb0-0da9-4233-81a0-7df42e15528e tempest-ListServerFiltersTestJSON-2708404 tempest-ListServerFiltersTestJSON-2708404-project-member] Enqueued Resource ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d with Priority: HIGHEST for action security_group_members [ 677.810443] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d with Priority: HIGHEST for action security_group_members [ 677.810443] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-823c6679-501c-4ec2-9d9f-f49b7cc1205d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.810443] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.445634] env[69506]: INFO networking_nsxv3.common.synchronization [req-b14e473c-d9ce-46ff-9de4-0d1598f4ca82 req-aaeea045-df1f-4bfa-8ca3-01bba008edcb tempest-SecurityGroupRulesTestJSON-2004689177 tempest-SecurityGroupRulesTestJSON-2004689177-project-member] Enqueued Resource ID: bc24f0ac-dc61-42ba-a959-96164f8b9055 with Priority: HIGHEST for action security_group_rules [ 678.445634] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc24f0ac-dc61-42ba-a959-96164f8b9055 with Priority: HIGHEST for action security_group_rules [ 678.445634] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc24f0ac-dc61-42ba-a959-96164f8b9055 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.445634] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc24f0ac-dc61-42ba-a959-96164f8b9055" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.445634] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc24f0ac-dc61-42ba-a959-96164f8b9055" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.445634] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc24f0ac-dc61-42ba-a959-96164f8b9055" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.445634] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc24f0ac-dc61-42ba-a959-96164f8b9055',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.450619] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 in Status: SUCCESS [ 678.450861] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.463233] env[69506]: INFO networking_nsxv3.common.synchronization [req-f8209707-ea3a-434b-8e3f-4e812002d656 req-d060a1e1-e6e7-46b2-85d6-92f03c2a746a tempest-ServerDiskConfigTestJSON-583020681 tempest-ServerDiskConfigTestJSON-583020681-project-member] Enqueued Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_members [ 678.463867] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_members [ 678.464854] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-008501d4-938b-4336-9c1d-ef3665f7d09d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.465057] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.465125] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.465350] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.465529] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.465635] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.465694] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.465872] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.466110] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.466275] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.882098] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-167 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.882313] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-167" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.882440] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-167" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.882713] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-167" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.882972] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.886117] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.886289] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.886539] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.886692] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.886911] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 678.887046] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 678.887201] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 678.887267] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 678.887414] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 678.887545] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 678.887751] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 678.905762] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 678.905934] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 678.906085] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 678.906261] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-167" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.906570] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-ddd9d246-7dad-4517-9f70-74dc395acca9 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.906745] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-ddd9d246-7dad-4517-9f70-74dc395acca9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.906879] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-ddd9d246-7dad-4517-9f70-74dc395acca9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.907200] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-ddd9d246-7dad-4517-9f70-74dc395acca9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.907339] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddd9d246-7dad-4517-9f70-74dc395acca9',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.969494] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.969494] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.969494] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.969494] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.969494] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.969494] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc24f0ac-dc61-42ba-a959-96164f8b9055 already deleted. [ 678.969494] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc24f0ac-dc61-42ba-a959-96164f8b9055" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.971849] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.971975] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.972056] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.972236] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.972322] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.972498] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.972595] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.972658] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.972802] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.972878] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.972961] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 008501d4-938b-4336-9c1d-ef3665f7d09d is going to be updated. [ 678.999714] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.999996] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.999996] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.000202] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.000335] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.008795] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 008501d4-938b-4336-9c1d-ef3665f7d09d in Status: IN_PROGRESS for 2s [ 679.410623] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.410918] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.411132] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.411433] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.411590] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.411747] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port ddd9d246-7dad-4517-9f70-74dc395acca9 not found, creating... [ 679.412017] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.412186] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.412305] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.412523] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.412664] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.412945] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.413367] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.413525] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.413742] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.413877] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.414027] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: ddd9d246-7dad-4517-9f70-74dc395acca9 is going to be created. [ 679.434846] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.434846] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.434846] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.434846] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.434846] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.434846] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-ddd9d246-7dad-4517-9f70-74dc395acca9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.707949] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d in Status: SUCCESS [ 679.708296] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.708774] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.709022] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.709227] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.709439] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.709439] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.709544] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.709629] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.709727] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('823c6679-501c-4ec2-9d9f-f49b7cc1205d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.061389] env[69506]: INFO networking_nsxv3.common.synchronization [req-775b0623-296a-4029-a028-07c8077b084a req-4e0e3e8b-8ca1-4c70-85aa-b26e25e0727b tempest-FloatingIPsAssociationNegativeTestJSON-1550362610 tempest-FloatingIPsAssociationNegativeTestJSON-1550362610-project-member] Enqueued Resource ID: c6cf0f63-443c-4fdc-9d02-4df041c1ea64 with Priority: HIGHEST for action security_group_members [ 680.062344] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6cf0f63-443c-4fdc-9d02-4df041c1ea64 with Priority: HIGHEST for action security_group_members [ 680.062698] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6cf0f63-443c-4fdc-9d02-4df041c1ea64 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.063367] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6cf0f63-443c-4fdc-9d02-4df041c1ea64" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.063367] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6cf0f63-443c-4fdc-9d02-4df041c1ea64" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.063367] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6cf0f63-443c-4fdc-9d02-4df041c1ea64" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.063367] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.063367] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.063863] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.063863] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.063863] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.063863] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6cf0f63-443c-4fdc-9d02-4df041c1ea64',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.211494] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('823c6679-501c-4ec2-9d9f-f49b7cc1205d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.297783] env[69506]: INFO networking_nsxv3.common.synchronization [None req-879321fc-b6c6-417e-b3af-1d7b2629df79 None None] Enqueued Resource ID: 013df416-ec35-48b9-88c1-0ac9baa4f482 with Priority: HIGHEST for action port [ 680.298385] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 013df416-ec35-48b9-88c1-0ac9baa4f482 with Priority: HIGHEST for action port [ 680.298714] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-013df416-ec35-48b9-88c1-0ac9baa4f482 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.298842] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-013df416-ec35-48b9-88c1-0ac9baa4f482" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.298909] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-013df416-ec35-48b9-88c1-0ac9baa4f482" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.301252] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-013df416-ec35-48b9-88c1-0ac9baa4f482" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.301252] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('013df416-ec35-48b9-88c1-0ac9baa4f482',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.567918] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.568469] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.568622] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.569261] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.569261] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.569835] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.569835] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.569835] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.570082] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.570082] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.570163] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6cf0f63-443c-4fdc-9d02-4df041c1ea64 is going to be updated. [ 680.595224] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.595303] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.595350] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.595656] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.595749] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.606969] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6cf0f63-443c-4fdc-9d02-4df041c1ea64 in Status: IN_PROGRESS for 2s [ 680.714866] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('823c6679-501c-4ec2-9d9f-f49b7cc1205d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.792460] env[69506]: INFO networking_nsxv3.common.synchronization [req-791057d2-5a3b-4f4d-bcd5-dd58c26bba6f req-ed122221-f594-4c64-a94f-60710a2b0aeb service nova] Enqueued Resource ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d with Priority: HIGHEST for action security_group_rules [ 680.792460] env[69506]: INFO networking_nsxv3.common.synchronization [req-791057d2-5a3b-4f4d-bcd5-dd58c26bba6f req-ed122221-f594-4c64-a94f-60710a2b0aeb service nova] Enqueued Resource ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d with Priority: HIGHEST for action security_group_members [ 680.792460] env[69506]: INFO networking_nsxv3.common.synchronization [req-791057d2-5a3b-4f4d-bcd5-dd58c26bba6f req-ed122221-f594-4c64-a94f-60710a2b0aeb service nova] Enqueued Resource ID: ddd9d246-7dad-4517-9f70-74dc395acca9 with Priority: HIGHEST for action port [ 680.792460] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d with Priority: HIGHEST for action security_group_rules [ 680.792460] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d with Priority: HIGHEST for action security_group_members [ 680.792460] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddd9d246-7dad-4517-9f70-74dc395acca9 with Priority: HIGHEST for action port [ 680.793068] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-823c6679-501c-4ec2-9d9f-f49b7cc1205d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.793068] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.793186] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-823c6679-501c-4ec2-9d9f-f49b7cc1205d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.793238] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.794795] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-ddd9d246-7dad-4517-9f70-74dc395acca9 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.794795] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ddd9d246-7dad-4517-9f70-74dc395acca9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.794795] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ddd9d246-7dad-4517-9f70-74dc395acca9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.794795] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ddd9d246-7dad-4517-9f70-74dc395acca9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.794795] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddd9d246-7dad-4517-9f70-74dc395acca9',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.803386] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 013df416-ec35-48b9-88c1-0ac9baa4f482 [ 680.803386] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.803386] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.803386] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.803386] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.803386] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.803820] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:013df416-ec35-48b9-88c1-0ac9baa4f482 already deleted. [ 680.803820] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-013df416-ec35-48b9-88c1-0ac9baa4f482" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.011812] env[69506]: INFO networking_nsxv3.common.synchronization [req-0f7ea427-8623-491a-af25-b2428e67b24d req-2fa1ea84-7211-45e7-8e82-0c2ef9825576 tempest-AttachInterfacesTestJSON-2055467997 tempest-AttachInterfacesTestJSON-2055467997-project-member] Enqueued Resource ID: 56702d6b-7f85-46e1-bf9f-c5bba683fb41 with Priority: HIGHEST for action security_group_members [ 681.013922] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56702d6b-7f85-46e1-bf9f-c5bba683fb41 with Priority: HIGHEST for action security_group_members [ 681.014363] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-56702d6b-7f85-46e1-bf9f-c5bba683fb41 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.014527] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56702d6b-7f85-46e1-bf9f-c5bba683fb41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.014623] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56702d6b-7f85-46e1-bf9f-c5bba683fb41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.015021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56702d6b-7f85-46e1-bf9f-c5bba683fb41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.017529] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.017662] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.017734] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.017961] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.018102] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.018245] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56702d6b-7f85-46e1-bf9f-c5bba683fb41',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.026655] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 008501d4-938b-4336-9c1d-ef3665f7d09d in Status: SUCCESS [ 681.026761] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 008501d4-938b-4336-9c1d-ef3665f7d09d deletion is rescheduled due to dependency. [ 681.026905] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.219387] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.220269] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.220269] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.220417] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.220634] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.221052] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d is going to be updated. [ 681.260892] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.261099] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.261180] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.261335] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.261475] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.274465] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d in Status: IN_PROGRESS for 2s [ 681.295387] env[69506]: INFO networking_nsxv3.common.synchronization [None req-2ff25ec8-d7e3-4a40-b3dd-9635c10fd36d None None] Enqueued Resource ID: 2932692c-6ea6-49e3-97ec-ed1bf468f5d7 with Priority: HIGHEST for action port [ 681.295936] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ddd9d246-7dad-4517-9f70-74dc395acca9 with status ACTIVE [ 681.298166] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.298166] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.298166] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.298166] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.298166] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.298166] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.298166] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.298166] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.298166] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.298166] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.299342] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.300238] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.300238] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.300238] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.300401] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.300401] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ddd9d246-7dad-4517-9f70-74dc395acca9 is going to be updated. [ 681.301649] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2932692c-6ea6-49e3-97ec-ed1bf468f5d7 with Priority: HIGHEST for action port [ 681.302380] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-2932692c-6ea6-49e3-97ec-ed1bf468f5d7 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.302501] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2932692c-6ea6-49e3-97ec-ed1bf468f5d7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.302638] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2932692c-6ea6-49e3-97ec-ed1bf468f5d7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.302778] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2932692c-6ea6-49e3-97ec-ed1bf468f5d7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.304371] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2932692c-6ea6-49e3-97ec-ed1bf468f5d7',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.331437] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.331913] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.331913] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.331913] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.332081] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.332157] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ddd9d246-7dad-4517-9f70-74dc395acca9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.522771] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.522771] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.522771] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.522771] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.522771] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.522771] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.522771] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.522771] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.522771] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.522771] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.522771] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56702d6b-7f85-46e1-bf9f-c5bba683fb41 already deleted. [ 681.522771] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56702d6b-7f85-46e1-bf9f-c5bba683fb41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.805585] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2932692c-6ea6-49e3-97ec-ed1bf468f5d7 [ 681.805866] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.806037] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.806037] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.806243] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.806340] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.806433] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2932692c-6ea6-49e3-97ec-ed1bf468f5d7 already deleted. [ 681.806525] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2932692c-6ea6-49e3-97ec-ed1bf468f5d7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.905184] env[69506]: INFO networking_nsxv3.common.synchronization [req-31cdb635-0133-45cf-819a-0badd7e02ebe req-7f0d17ae-859b-4671-be20-6e4a0c22ba78 tempest-SecurityGroupRulesTestJSON-2004689177 tempest-SecurityGroupRulesTestJSON-2004689177-project-member] Enqueued Resource ID: bc24f0ac-dc61-42ba-a959-96164f8b9055 with Priority: HIGHEST for action security_group_rules [ 681.905184] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc24f0ac-dc61-42ba-a959-96164f8b9055 with Priority: HIGHEST for action security_group_rules [ 681.905553] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc24f0ac-dc61-42ba-a959-96164f8b9055 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.906202] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc24f0ac-dc61-42ba-a959-96164f8b9055" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.906202] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc24f0ac-dc61-42ba-a959-96164f8b9055" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.906202] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc24f0ac-dc61-42ba-a959-96164f8b9055" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.906379] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc24f0ac-dc61-42ba-a959-96164f8b9055',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.952891] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-868 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.953114] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-868" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.953243] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-868" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.953603] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-868" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.953876] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.954149] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.954324] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.954528] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.954649] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.954859] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 681.954985] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 681.955134] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 681.955246] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 681.955359] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 681.955469] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 681.956729] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 681.981127] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 681.981127] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 681.981127] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 681.981275] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-868" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.982959] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-fb585ff8-b5d7-4c07-9b75-ac1a9a6ca8c5 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.983365] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-fb585ff8-b5d7-4c07-9b75-ac1a9a6ca8c5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.983470] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-fb585ff8-b5d7-4c07-9b75-ac1a9a6ca8c5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.984539] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-fb585ff8-b5d7-4c07-9b75-ac1a9a6ca8c5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.984626] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb585ff8-b5d7-4c07-9b75-ac1a9a6ca8c5',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.428295] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.428767] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.430014] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.430014] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.430014] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.430014] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc24f0ac-dc61-42ba-a959-96164f8b9055 already deleted. [ 682.430014] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc24f0ac-dc61-42ba-a959-96164f8b9055" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.491279] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.491587] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.491756] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.492446] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.492446] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.492581] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port fb585ff8-b5d7-4c07-9b75-ac1a9a6ca8c5 not found, creating... [ 682.492927] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.493057] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.493190] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.493489] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.493717] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.496479] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.496479] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.499056] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.499056] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.499056] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.499056] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: fb585ff8-b5d7-4c07-9b75-ac1a9a6ca8c5 is going to be created. [ 682.522020] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.522020] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.522020] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.522020] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.522020] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.522020] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-fb585ff8-b5d7-4c07-9b75-ac1a9a6ca8c5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.616129] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6cf0f63-443c-4fdc-9d02-4df041c1ea64 in Status: SUCCESS [ 682.616129] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6cf0f63-443c-4fdc-9d02-4df041c1ea64 deletion is rescheduled due to dependency. [ 682.616129] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6cf0f63-443c-4fdc-9d02-4df041c1ea64" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.163965] env[69506]: INFO networking_nsxv3.common.synchronization [None req-ac4866ca-cf68-4b84-8f2b-131c87fedde3 None None] Enqueued Resource ID: 1468b671-56ee-4615-946d-ccf4455b46a5 with Priority: HIGHEST for action port [ 683.164280] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1468b671-56ee-4615-946d-ccf4455b46a5 with Priority: HIGHEST for action port [ 683.164874] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-1468b671-56ee-4615-946d-ccf4455b46a5 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.164997] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1468b671-56ee-4615-946d-ccf4455b46a5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.165084] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1468b671-56ee-4615-946d-ccf4455b46a5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.165333] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1468b671-56ee-4615-946d-ccf4455b46a5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.165429] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1468b671-56ee-4615-946d-ccf4455b46a5',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.284856] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d in Status: SUCCESS [ 683.286219] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.286418] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.286642] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.287709] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.287853] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.287920] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.288117] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.288204] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.288292] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.288486] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-823c6679-501c-4ec2-9d9f-f49b7cc1205d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.288655] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.288655] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.288799] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.288942] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.290545] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.291608] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.291830] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.291925] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.292031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.292148] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('823c6679-501c-4ec2-9d9f-f49b7cc1205d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.293051] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.293227] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.293387] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.293494] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.293560] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.293716] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.293791] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.293876] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('823c6679-501c-4ec2-9d9f-f49b7cc1205d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.390188] env[69506]: INFO networking_nsxv3.common.synchronization [req-3feb1233-7adf-475f-adec-adf95536eb59 req-089e8e20-13d2-44d3-9ae0-32d19834e235 tempest-ServerMetadataNegativeTestJSON-1368420188 tempest-ServerMetadataNegativeTestJSON-1368420188-project-member] Enqueued Resource ID: 9e830a1e-918a-49a7-b725-f68307282e6e with Priority: HIGHEST for action security_group_members [ 683.390188] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e830a1e-918a-49a7-b725-f68307282e6e with Priority: HIGHEST for action security_group_members [ 683.390188] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e830a1e-918a-49a7-b725-f68307282e6e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.390188] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e830a1e-918a-49a7-b725-f68307282e6e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.390188] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e830a1e-918a-49a7-b725-f68307282e6e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.393620] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e830a1e-918a-49a7-b725-f68307282e6e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.393910] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.394024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.394170] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.394440] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.394605] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.394786] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e830a1e-918a-49a7-b725-f68307282e6e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.669942] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1468b671-56ee-4615-946d-ccf4455b46a5 [ 683.669942] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.669942] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.669942] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.669942] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.669942] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.670387] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1468b671-56ee-4615-946d-ccf4455b46a5 already deleted. [ 683.671510] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1468b671-56ee-4615-946d-ccf4455b46a5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.781185] env[69506]: INFO networking_nsxv3.common.synchronization [req-0f7ea427-8623-491a-af25-b2428e67b24d req-cb6da79e-56bf-4901-ac75-e85d879ef433 service nova] Enqueued Resource ID: 56702d6b-7f85-46e1-bf9f-c5bba683fb41 with Priority: HIGHEST for action security_group_rules [ 683.781359] env[69506]: INFO networking_nsxv3.common.synchronization [req-0f7ea427-8623-491a-af25-b2428e67b24d req-cb6da79e-56bf-4901-ac75-e85d879ef433 service nova] Enqueued Resource ID: 56702d6b-7f85-46e1-bf9f-c5bba683fb41 with Priority: HIGHEST for action security_group_members [ 683.781496] env[69506]: INFO networking_nsxv3.common.synchronization [req-0f7ea427-8623-491a-af25-b2428e67b24d req-cb6da79e-56bf-4901-ac75-e85d879ef433 service nova] Enqueued Resource ID: fb585ff8-b5d7-4c07-9b75-ac1a9a6ca8c5 with Priority: HIGHEST for action port [ 683.782075] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56702d6b-7f85-46e1-bf9f-c5bba683fb41 with Priority: HIGHEST for action security_group_rules [ 683.782174] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56702d6b-7f85-46e1-bf9f-c5bba683fb41 with Priority: HIGHEST for action security_group_members [ 683.782770] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb585ff8-b5d7-4c07-9b75-ac1a9a6ca8c5 with Priority: HIGHEST for action port [ 683.783320] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-56702d6b-7f85-46e1-bf9f-c5bba683fb41 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.783488] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-56702d6b-7f85-46e1-bf9f-c5bba683fb41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.783535] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-56702d6b-7f85-46e1-bf9f-c5bba683fb41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.783720] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-56702d6b-7f85-46e1-bf9f-c5bba683fb41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.783809] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('56702d6b-7f85-46e1-bf9f-c5bba683fb41',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.785978] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-56702d6b-7f85-46e1-bf9f-c5bba683fb41 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.786123] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56702d6b-7f85-46e1-bf9f-c5bba683fb41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.786193] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56702d6b-7f85-46e1-bf9f-c5bba683fb41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.786527] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56702d6b-7f85-46e1-bf9f-c5bba683fb41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.786772] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.786772] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.786772] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.787273] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.787273] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.787273] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56702d6b-7f85-46e1-bf9f-c5bba683fb41',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.788245] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb585ff8-b5d7-4c07-9b75-ac1a9a6ca8c5 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.788377] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb585ff8-b5d7-4c07-9b75-ac1a9a6ca8c5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.788456] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb585ff8-b5d7-4c07-9b75-ac1a9a6ca8c5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.788726] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb585ff8-b5d7-4c07-9b75-ac1a9a6ca8c5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.788808] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb585ff8-b5d7-4c07-9b75-ac1a9a6ca8c5',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.795584] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 823c6679-501c-4ec2-9d9f-f49b7cc1205d: rpc.has_security_group_logging(os_id): False [ 683.798064] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('823c6679-501c-4ec2-9d9f-f49b7cc1205d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.817381] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.817381] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.817381] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.817381] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.817381] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.817381] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.817381] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.817381] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.817381] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.817381] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.817381] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.817381] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.817381] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.818275] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.818275] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.818275] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.818275] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.818275] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.818455] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.819928] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.819928] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d is going to be created. [ 683.877867] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.877867] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.877867] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.877867] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.877867] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.886166] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d in Status: IN_PROGRESS for 2s [ 683.897793] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.898101] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.898101] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.898347] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.898432] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.898687] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.898863] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.898863] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.899020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.899239] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.899239] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e830a1e-918a-49a7-b725-f68307282e6e already deleted. [ 683.899323] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e830a1e-918a-49a7-b725-f68307282e6e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.088159] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-102 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.088159] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-102" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.088159] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-102" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.088159] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-102" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.089132] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.089553] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.089859] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.090846] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.091213] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.091650] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 684.092078] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 684.092369] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 684.092755] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 684.093061] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 684.093346] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 684.093659] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 684.111189] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 684.114211] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 684.114211] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 684.114211] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-102" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.114211] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-1b1e928b-2bb1-4515-bd1f-33d13dd15425 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.114211] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-1b1e928b-2bb1-4515-bd1f-33d13dd15425" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.114211] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-1b1e928b-2bb1-4515-bd1f-33d13dd15425" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.118080] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-1b1e928b-2bb1-4515-bd1f-33d13dd15425" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.118080] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b1e928b-2bb1-4515-bd1f-33d13dd15425',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.118399] env[69506]: INFO networking_nsxv3.common.synchronization [None req-57292363-e21f-49a8-a0ad-6f2107298489 None None] Enqueued Resource ID: 06131d46-1d30-402c-a9d1-750a23529b59 with Priority: HIGHEST for action port [ 684.119031] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06131d46-1d30-402c-a9d1-750a23529b59 with Priority: HIGHEST for action port [ 684.120169] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-06131d46-1d30-402c-a9d1-750a23529b59 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.120305] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06131d46-1d30-402c-a9d1-750a23529b59" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.120376] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06131d46-1d30-402c-a9d1-750a23529b59" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.121799] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06131d46-1d30-402c-a9d1-750a23529b59" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.121915] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06131d46-1d30-402c-a9d1-750a23529b59',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.293204] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-56702d6b-7f85-46e1-bf9f-c5bba683fb41 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.293204] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56702d6b-7f85-46e1-bf9f-c5bba683fb41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.293204] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('56702d6b-7f85-46e1-bf9f-c5bba683fb41',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.297141] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fb585ff8-b5d7-4c07-9b75-ac1a9a6ca8c5 with status ACTIVE [ 684.297141] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.297141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.297141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.297141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.297141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.297141] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.297141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.297141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.297141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.297141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.297141] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.297141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.297141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.297141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.297141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.297141] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fb585ff8-b5d7-4c07-9b75-ac1a9a6ca8c5 is going to be updated. [ 684.306199] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('823c6679-501c-4ec2-9d9f-f49b7cc1205d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.317148] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.317319] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.317384] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.317602] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.317735] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.317964] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb585ff8-b5d7-4c07-9b75-ac1a9a6ca8c5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.618045] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.619404] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.619404] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.620326] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.620326] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.620326] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 1b1e928b-2bb1-4515-bd1f-33d13dd15425 not found, creating... [ 684.620688] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.620880] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.621008] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.621331] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.621481] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.621779] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.621938] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.622180] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.622427] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.622575] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.622725] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 1b1e928b-2bb1-4515-bd1f-33d13dd15425 is going to be created. [ 684.623994] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 06131d46-1d30-402c-a9d1-750a23529b59 [ 684.624210] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.625308] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.625308] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.625308] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.625308] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.625308] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:06131d46-1d30-402c-a9d1-750a23529b59 already deleted. [ 684.625308] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06131d46-1d30-402c-a9d1-750a23529b59" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.642943] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.643148] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.643278] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.643548] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.643774] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.644013] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-1b1e928b-2bb1-4515-bd1f-33d13dd15425" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.802432] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('56702d6b-7f85-46e1-bf9f-c5bba683fb41',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.806104] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.806272] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.806374] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.806622] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.806716] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.806809] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d is going to be updated. [ 684.838104] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.838104] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.838104] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.838104] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.838104] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.843987] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d in Status: IN_PROGRESS for 2s [ 684.888911] env[69506]: INFO networking_nsxv3.common.synchronization [None req-57984fb9-3f8a-4141-81e4-77a77f26b21d tempest-ServerActionsTestOtherB-347258904 tempest-ServerActionsTestOtherB-347258904-project-member] Enqueued Resource ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 with Priority: HIGHEST for action security_group_rules [ 684.889396] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 with Priority: HIGHEST for action security_group_rules [ 684.890166] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.890350] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.890454] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.892271] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.892271] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fca9cd47-c1fb-4023-8f12-fa1b22a98fd8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.247423] env[69506]: INFO networking_nsxv3.common.synchronization [None req-0686c13a-a159-4b31-a92e-fc578c984bd4 tempest-ServerActionsTestOtherB-347258904 tempest-ServerActionsTestOtherB-347258904-project-member] Enqueued Resource ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 with Priority: HIGHEST for action security_group_rules [ 685.252106] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 with Priority: HIGHEST for action security_group_rules [ 685.252830] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.252930] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.306168] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.306457] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.306457] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.306989] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.306989] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.306989] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56702d6b-7f85-46e1-bf9f-c5bba683fb41 is going to be created. [ 685.332745] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.332908] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.332978] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.333213] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.333410] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.345024] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56702d6b-7f85-46e1-bf9f-c5bba683fb41 in Status: UNINITIALIZED for 2s [ 685.414218] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.414411] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.414466] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.415012] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.415220] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.415786] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 already deleted. [ 685.415786] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.415786] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.415942] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.415942] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fca9cd47-c1fb-4023-8f12-fa1b22a98fd8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.902677] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d in Status: SUCCESS [ 685.902939] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.903133] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.903362] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.903451] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('823c6679-501c-4ec2-9d9f-f49b7cc1205d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.944513] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.944710] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.944710] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.944887] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.944987] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.945104] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 already deleted. [ 685.945190] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.978184] env[69506]: INFO networking_nsxv3.common.synchronization [req-3feb1233-7adf-475f-adec-adf95536eb59 req-ebffb4d4-1a70-4b34-af6e-49ef1733f6d3 service nova] Enqueued Resource ID: 9e830a1e-918a-49a7-b725-f68307282e6e with Priority: HIGHEST for action security_group_rules [ 685.978184] env[69506]: INFO networking_nsxv3.common.synchronization [req-3feb1233-7adf-475f-adec-adf95536eb59 req-ebffb4d4-1a70-4b34-af6e-49ef1733f6d3 service nova] Enqueued Resource ID: 9e830a1e-918a-49a7-b725-f68307282e6e with Priority: HIGHEST for action security_group_members [ 685.978184] env[69506]: INFO networking_nsxv3.common.synchronization [req-3feb1233-7adf-475f-adec-adf95536eb59 req-ebffb4d4-1a70-4b34-af6e-49ef1733f6d3 service nova] Enqueued Resource ID: 1b1e928b-2bb1-4515-bd1f-33d13dd15425 with Priority: HIGHEST for action port [ 685.979471] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e830a1e-918a-49a7-b725-f68307282e6e with Priority: HIGHEST for action security_group_rules [ 685.979471] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e830a1e-918a-49a7-b725-f68307282e6e with Priority: HIGHEST for action security_group_members [ 685.979471] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b1e928b-2bb1-4515-bd1f-33d13dd15425 with Priority: HIGHEST for action port [ 685.980358] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e830a1e-918a-49a7-b725-f68307282e6e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.980432] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e830a1e-918a-49a7-b725-f68307282e6e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.980477] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e830a1e-918a-49a7-b725-f68307282e6e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.980707] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e830a1e-918a-49a7-b725-f68307282e6e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.980800] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e830a1e-918a-49a7-b725-f68307282e6e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.982273] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e830a1e-918a-49a7-b725-f68307282e6e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.982273] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e830a1e-918a-49a7-b725-f68307282e6e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.982273] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e830a1e-918a-49a7-b725-f68307282e6e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.982273] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e830a1e-918a-49a7-b725-f68307282e6e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.982273] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.982725] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.982725] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.982725] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.982725] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.982725] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e830a1e-918a-49a7-b725-f68307282e6e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.986342] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b1e928b-2bb1-4515-bd1f-33d13dd15425 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.986496] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b1e928b-2bb1-4515-bd1f-33d13dd15425" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.986568] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b1e928b-2bb1-4515-bd1f-33d13dd15425" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.986700] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b1e928b-2bb1-4515-bd1f-33d13dd15425" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.986829] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b1e928b-2bb1-4515-bd1f-33d13dd15425',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.996343] env[69506]: INFO networking_nsxv3.common.synchronization [req-da170bff-78bf-4c3c-8efd-03692b35e902 req-32108125-1352-404a-ad2b-3c98ecca008f tempest-VolumesAdminNegativeTest-1438419906 tempest-VolumesAdminNegativeTest-1438419906-project-member] Enqueued Resource ID: 1bceaf9d-1c44-4281-83d2-4109ac0771c7 with Priority: HIGHEST for action security_group_members [ 685.997767] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bceaf9d-1c44-4281-83d2-4109ac0771c7 with Priority: HIGHEST for action security_group_members [ 685.998094] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bceaf9d-1c44-4281-83d2-4109ac0771c7 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.998219] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.998306] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.998600] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.000138] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.000138] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.000138] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.000138] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.000138] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.000138] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bceaf9d-1c44-4281-83d2-4109ac0771c7',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.405757] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-823c6679-501c-4ec2-9d9f-f49b7cc1205d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.407134] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.488408] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1b1e928b-2bb1-4515-bd1f-33d13dd15425 with status ACTIVE [ 686.488664] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.488819] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.488884] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.489498] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.489616] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.489835] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.489970] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.490066] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.490257] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.490356] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.490579] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.490780] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.490899] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.491040] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.491138] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.491242] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1b1e928b-2bb1-4515-bd1f-33d13dd15425 is going to be updated. [ 686.492739] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e830a1e-918a-49a7-b725-f68307282e6e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.493914] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e830a1e-918a-49a7-b725-f68307282e6e taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.493914] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e830a1e-918a-49a7-b725-f68307282e6e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.504552] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.505182] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.505182] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.505182] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.505182] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.505908] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.505908] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.505908] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.505908] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.506085] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.506085] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bceaf9d-1c44-4281-83d2-4109ac0771c7 already deleted. [ 686.506166] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.513686] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.513832] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.514715] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.514715] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.514715] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.514715] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b1e928b-2bb1-4515-bd1f-33d13dd15425" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.859632] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d in Status: SUCCESS [ 686.859632] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.859839] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.860215] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.860301] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.860366] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.860999] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.860999] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.860999] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.860999] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('823c6679-501c-4ec2-9d9f-f49b7cc1205d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.995627] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e830a1e-918a-49a7-b725-f68307282e6e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.053527] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-484 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.053527] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-484" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.053527] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-484" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.053527] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-484" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.053527] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.053527] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.053527] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.054043] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.054212] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.054472] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 687.054636] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 687.054717] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 687.054820] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 687.054953] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 687.055088] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 687.055248] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 687.073807] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 687.073807] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 687.073807] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 687.073984] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-484" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.074407] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-13c01da1-7b15-4d41-a0d5-53321c0cc9f6 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.074474] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-13c01da1-7b15-4d41-a0d5-53321c0cc9f6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.074608] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-13c01da1-7b15-4d41-a0d5-53321c0cc9f6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.074925] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-13c01da1-7b15-4d41-a0d5-53321c0cc9f6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.075105] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13c01da1-7b15-4d41-a0d5-53321c0cc9f6',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.354362] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56702d6b-7f85-46e1-bf9f-c5bba683fb41 in Status: SUCCESS [ 687.354362] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56702d6b-7f85-46e1-bf9f-c5bba683fb41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.354853] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56702d6b-7f85-46e1-bf9f-c5bba683fb41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.355080] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56702d6b-7f85-46e1-bf9f-c5bba683fb41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.355277] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.355395] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.355462] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.355615] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.355697] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.355782] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56702d6b-7f85-46e1-bf9f-c5bba683fb41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.355873] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('56702d6b-7f85-46e1-bf9f-c5bba683fb41',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.364751] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('823c6679-501c-4ec2-9d9f-f49b7cc1205d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.498755] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.502297] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.502297] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.502297] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.502297] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.502297] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e830a1e-918a-49a7-b725-f68307282e6e is going to be created. [ 687.520995] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.521172] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.521241] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.521447] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.521659] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.530834] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e830a1e-918a-49a7-b725-f68307282e6e in Status: UNINITIALIZED for 2s [ 687.579305] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.579535] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.579671] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.580029] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.580119] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.580329] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 13c01da1-7b15-4d41-a0d5-53321c0cc9f6 not found, creating... [ 687.580640] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.580817] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.580938] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.581243] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.581320] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.581606] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.581768] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.581933] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.582721] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.582892] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.583063] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 13c01da1-7b15-4d41-a0d5-53321c0cc9f6 is going to be created. [ 687.610548] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.610805] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.610934] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.611249] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.611518] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.612096] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-13c01da1-7b15-4d41-a0d5-53321c0cc9f6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.861234] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('56702d6b-7f85-46e1-bf9f-c5bba683fb41',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.867130] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('823c6679-501c-4ec2-9d9f-f49b7cc1205d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.363905] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 56702d6b-7f85-46e1-bf9f-c5bba683fb41: rpc.has_security_group_logging(os_id): False [ 688.372114] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.372550] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.372550] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.372675] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.372792] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.372973] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d is going to be updated. [ 688.386103] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.386103] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.386103] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.386103] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.386103] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.386103] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.386103] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.386598] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.386598] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.386598] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.386598] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 56702d6b-7f85-46e1-bf9f-c5bba683fb41 is going to be created. [ 688.413396] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.413538] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.413614] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.413832] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.413965] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.422023] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d in Status: IN_PROGRESS for 2s [ 688.460901] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.461115] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.461154] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.461924] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.461924] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.474051] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56702d6b-7f85-46e1-bf9f-c5bba683fb41 in Status: IN_PROGRESS for 2s [ 688.652513] env[69506]: INFO networking_nsxv3.common.synchronization [req-da170bff-78bf-4c3c-8efd-03692b35e902 req-d7255cc6-dc01-4fbb-8725-cffe897ed276 service nova] Enqueued Resource ID: 1bceaf9d-1c44-4281-83d2-4109ac0771c7 with Priority: HIGHEST for action security_group_rules [ 688.652804] env[69506]: INFO networking_nsxv3.common.synchronization [req-da170bff-78bf-4c3c-8efd-03692b35e902 req-d7255cc6-dc01-4fbb-8725-cffe897ed276 service nova] Enqueued Resource ID: 1bceaf9d-1c44-4281-83d2-4109ac0771c7 with Priority: HIGHEST for action security_group_members [ 688.652844] env[69506]: INFO networking_nsxv3.common.synchronization [req-da170bff-78bf-4c3c-8efd-03692b35e902 req-d7255cc6-dc01-4fbb-8725-cffe897ed276 service nova] Enqueued Resource ID: 13c01da1-7b15-4d41-a0d5-53321c0cc9f6 with Priority: HIGHEST for action port [ 688.653356] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bceaf9d-1c44-4281-83d2-4109ac0771c7 with Priority: HIGHEST for action security_group_rules [ 688.653493] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bceaf9d-1c44-4281-83d2-4109ac0771c7 with Priority: HIGHEST for action security_group_members [ 688.653592] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13c01da1-7b15-4d41-a0d5-53321c0cc9f6 with Priority: HIGHEST for action port [ 688.653866] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bceaf9d-1c44-4281-83d2-4109ac0771c7 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.653988] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.654284] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.654432] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.654535] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bceaf9d-1c44-4281-83d2-4109ac0771c7',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.656422] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bceaf9d-1c44-4281-83d2-4109ac0771c7 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.656566] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.656650] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.657892] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.657892] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.657892] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.657892] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.657892] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.657892] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.658126] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bceaf9d-1c44-4281-83d2-4109ac0771c7',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.660251] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-13c01da1-7b15-4d41-a0d5-53321c0cc9f6 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.660397] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13c01da1-7b15-4d41-a0d5-53321c0cc9f6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.660446] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13c01da1-7b15-4d41-a0d5-53321c0cc9f6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.660584] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13c01da1-7b15-4d41-a0d5-53321c0cc9f6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.660689] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13c01da1-7b15-4d41-a0d5-53321c0cc9f6',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.157618] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bceaf9d-1c44-4281-83d2-4109ac0771c7 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.157618] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.161252] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bceaf9d-1c44-4281-83d2-4109ac0771c7',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.165012] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 13c01da1-7b15-4d41-a0d5-53321c0cc9f6 with status ACTIVE [ 689.165494] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.166158] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.166257] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.166478] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.167031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.167287] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.167476] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.167584] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.167770] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.167967] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.168253] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.168375] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.168443] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.168677] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.168677] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.168764] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 13c01da1-7b15-4d41-a0d5-53321c0cc9f6 is going to be updated. [ 689.216339] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.216339] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.217025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.217025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.217025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.217224] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13c01da1-7b15-4d41-a0d5-53321c0cc9f6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.541873] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e830a1e-918a-49a7-b725-f68307282e6e in Status: SUCCESS [ 689.541873] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e830a1e-918a-49a7-b725-f68307282e6e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.541873] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e830a1e-918a-49a7-b725-f68307282e6e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.542211] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e830a1e-918a-49a7-b725-f68307282e6e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.542211] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.542335] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.542399] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.543678] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.543678] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.543678] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e830a1e-918a-49a7-b725-f68307282e6e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.543678] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e830a1e-918a-49a7-b725-f68307282e6e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.666445] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bceaf9d-1c44-4281-83d2-4109ac0771c7',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.045471] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e830a1e-918a-49a7-b725-f68307282e6e taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.046153] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e830a1e-918a-49a7-b725-f68307282e6e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.046153] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e830a1e-918a-49a7-b725-f68307282e6e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.046153] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e830a1e-918a-49a7-b725-f68307282e6e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.046364] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.046364] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.046479] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.046588] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.046646] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.046758] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e830a1e-918a-49a7-b725-f68307282e6e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.046901] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e830a1e-918a-49a7-b725-f68307282e6e taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.047132] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e830a1e-918a-49a7-b725-f68307282e6e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.047132] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e830a1e-918a-49a7-b725-f68307282e6e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.047223] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e830a1e-918a-49a7-b725-f68307282e6e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.047321] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.047408] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.047465] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.047664] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.047744] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.047823] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e830a1e-918a-49a7-b725-f68307282e6e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.047908] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e830a1e-918a-49a7-b725-f68307282e6e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.168569] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.168720] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.168779] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.168990] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.169092] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.169192] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bceaf9d-1c44-4281-83d2-4109ac0771c7 is going to be created. [ 690.193653] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.193806] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.193878] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.194127] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.194263] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.206355] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bceaf9d-1c44-4281-83d2-4109ac0771c7 in Status: UNINITIALIZED for 2s [ 690.432805] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d in Status: SUCCESS [ 690.433544] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.433784] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.434062] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.434362] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.434549] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.434638] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.434815] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.434976] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.434976] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.435108] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('823c6679-501c-4ec2-9d9f-f49b7cc1205d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.485094] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56702d6b-7f85-46e1-bf9f-c5bba683fb41 in Status: SUCCESS [ 690.485347] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-56702d6b-7f85-46e1-bf9f-c5bba683fb41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.549997] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e830a1e-918a-49a7-b725-f68307282e6e: rpc.has_security_group_logging(os_id): False [ 690.569088] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.569088] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.569088] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.569088] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.569088] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.569088] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.569088] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.569088] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.569088] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.569717] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.569717] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.569717] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.569717] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.570386] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.570386] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.570732] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.571117] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.571117] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.571411] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.571411] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.571411] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e830a1e-918a-49a7-b725-f68307282e6e is going to be created. [ 690.622227] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.622366] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.622366] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.622655] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.623498] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.632944] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e830a1e-918a-49a7-b725-f68307282e6e in Status: IN_PROGRESS for 2s [ 690.939992] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-823c6679-501c-4ec2-9d9f-f49b7cc1205d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.940350] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.940350] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.940928] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.941184] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.941299] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.941947] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.942241] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.942370] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.942525] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.942739] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-823c6679-501c-4ec2-9d9f-f49b7cc1205d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.942891] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.942997] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.943202] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.943408] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.943563] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.943718] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.943930] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.944070] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.944233] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.944448] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('823c6679-501c-4ec2-9d9f-f49b7cc1205d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.100146] env[69506]: INFO networking_nsxv3.common.synchronization [req-4818a146-25f5-4e48-a49b-0ef6b719685b req-ddb6a3c5-0309-420b-bf9e-fe9abeaf069d tempest-ServerExternalEventsTest-645571710 tempest-ServerExternalEventsTest-645571710-project-member] Enqueued Resource ID: a149f18b-817c-45ab-98f1-e5cc2ba7f60d with Priority: HIGHEST for action security_group_members [ 691.100146] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a149f18b-817c-45ab-98f1-e5cc2ba7f60d with Priority: HIGHEST for action security_group_members [ 691.100146] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-a149f18b-817c-45ab-98f1-e5cc2ba7f60d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.100813] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a149f18b-817c-45ab-98f1-e5cc2ba7f60d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.100926] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a149f18b-817c-45ab-98f1-e5cc2ba7f60d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.101195] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a149f18b-817c-45ab-98f1-e5cc2ba7f60d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.101366] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.101470] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.101541] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.101704] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.101796] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.102114] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a149f18b-817c-45ab-98f1-e5cc2ba7f60d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.447484] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 823c6679-501c-4ec2-9d9f-f49b7cc1205d: rpc.has_security_group_logging(os_id): False [ 691.464750] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.465125] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.465246] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.465494] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.465590] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.465825] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.465920] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.465985] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.469519] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.469519] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.469519] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.469519] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.469519] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.469519] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.469519] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.469519] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.469519] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.470352] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.470352] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.470352] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.470352] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d is going to be updated. [ 691.525609] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.525805] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.525881] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.526116] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.526260] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.537958] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d in Status: IN_PROGRESS for 2s [ 691.605575] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.605827] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.605932] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.606260] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.606414] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.607069] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.607069] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.607069] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.607297] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.607297] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.607417] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a149f18b-817c-45ab-98f1-e5cc2ba7f60d already deleted. [ 691.607513] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a149f18b-817c-45ab-98f1-e5cc2ba7f60d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.101934] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-438 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.102394] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.102394] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.102550] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.102811] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.102974] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.103408] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.103832] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.103908] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.104189] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 692.104358] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 692.104552] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 692.104679] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 692.104866] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 692.105033] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 692.105225] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 692.124116] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 692.124342] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 692.124468] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 692.124626] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.124981] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-23b18f69-8cd7-4633-af71-a07c3e419a19 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.125288] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-23b18f69-8cd7-4633-af71-a07c3e419a19" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.125416] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-23b18f69-8cd7-4633-af71-a07c3e419a19" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.125766] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-23b18f69-8cd7-4633-af71-a07c3e419a19" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.125948] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23b18f69-8cd7-4633-af71-a07c3e419a19',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.197676] env[69506]: INFO networking_nsxv3.common.synchronization [None req-0cb9e2e6-1d23-41cd-b76d-f15c179bb933 None None] Enqueued Resource ID: ab99a4f3-6dda-4e64-849a-57dd4697c7e5 with Priority: HIGHEST for action port [ 692.200136] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab99a4f3-6dda-4e64-849a-57dd4697c7e5 with Priority: HIGHEST for action port [ 692.200506] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab99a4f3-6dda-4e64-849a-57dd4697c7e5 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.200643] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab99a4f3-6dda-4e64-849a-57dd4697c7e5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.200696] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab99a4f3-6dda-4e64-849a-57dd4697c7e5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.201610] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab99a4f3-6dda-4e64-849a-57dd4697c7e5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.202277] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab99a4f3-6dda-4e64-849a-57dd4697c7e5',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.226033] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bceaf9d-1c44-4281-83d2-4109ac0771c7 in Status: SUCCESS [ 692.226033] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.226033] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.226033] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.226033] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.226033] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.226033] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.226033] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.226033] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.226033] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.226033] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1bceaf9d-1c44-4281-83d2-4109ac0771c7',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.630547] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.631372] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.631528] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.631860] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.632068] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.632299] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 23b18f69-8cd7-4633-af71-a07c3e419a19 not found, creating... [ 692.632585] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.632795] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.632927] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.633187] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.633407] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.633682] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.633874] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.634014] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.637178] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.637178] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.637178] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 23b18f69-8cd7-4633-af71-a07c3e419a19 is going to be created. [ 692.649911] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e830a1e-918a-49a7-b725-f68307282e6e in Status: SUCCESS [ 692.650196] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e830a1e-918a-49a7-b725-f68307282e6e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.658534] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.659213] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.659328] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.660651] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.660651] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.660971] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-23b18f69-8cd7-4633-af71-a07c3e419a19" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.705155] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ab99a4f3-6dda-4e64-849a-57dd4697c7e5 [ 692.705543] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.705778] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.705917] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.706330] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.708576] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.708576] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ab99a4f3-6dda-4e64-849a-57dd4697c7e5 already deleted. [ 692.708576] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab99a4f3-6dda-4e64-849a-57dd4697c7e5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.730307] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1bceaf9d-1c44-4281-83d2-4109ac0771c7',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.234791] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1bceaf9d-1c44-4281-83d2-4109ac0771c7: rpc.has_security_group_logging(os_id): False [ 693.251380] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.251519] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.251588] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.251815] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.251889] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.252128] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.252227] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.252290] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.252435] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.252509] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.252600] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bceaf9d-1c44-4281-83d2-4109ac0771c7 is going to be created. [ 693.304859] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.305679] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.305769] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.306017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.306224] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.317119] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bceaf9d-1c44-4281-83d2-4109ac0771c7 in Status: IN_PROGRESS for 2s [ 693.554310] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d in Status: SUCCESS [ 693.554573] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.554813] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.555048] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.555217] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('823c6679-501c-4ec2-9d9f-f49b7cc1205d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.826304] env[69506]: INFO networking_nsxv3.common.synchronization [None req-2f6e2f06-34b8-4d38-bec4-f5cb60bd428d None None] Enqueued Resource ID: 1921ed7c-c558-4eec-9eb2-06038cb54409 with Priority: HIGHEST for action port [ 693.828209] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1921ed7c-c558-4eec-9eb2-06038cb54409 with Priority: HIGHEST for action port [ 693.828209] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-1921ed7c-c558-4eec-9eb2-06038cb54409 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.828513] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1921ed7c-c558-4eec-9eb2-06038cb54409" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.828711] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1921ed7c-c558-4eec-9eb2-06038cb54409" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.829141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1921ed7c-c558-4eec-9eb2-06038cb54409" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.829349] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1921ed7c-c558-4eec-9eb2-06038cb54409',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.061776] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-823c6679-501c-4ec2-9d9f-f49b7cc1205d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.061947] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.062043] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.062268] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.062434] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.062536] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.062597] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.062745] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.062836] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.062927] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.063037] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('823c6679-501c-4ec2-9d9f-f49b7cc1205d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.236138] env[69506]: INFO networking_nsxv3.common.synchronization [req-4818a146-25f5-4e48-a49b-0ef6b719685b req-f1829f82-6c44-4ba7-9797-31cca2844133 service nova] Enqueued Resource ID: a149f18b-817c-45ab-98f1-e5cc2ba7f60d with Priority: HIGHEST for action security_group_rules [ 694.236138] env[69506]: INFO networking_nsxv3.common.synchronization [req-4818a146-25f5-4e48-a49b-0ef6b719685b req-f1829f82-6c44-4ba7-9797-31cca2844133 service nova] Enqueued Resource ID: a149f18b-817c-45ab-98f1-e5cc2ba7f60d with Priority: HIGHEST for action security_group_members [ 694.236138] env[69506]: INFO networking_nsxv3.common.synchronization [req-4818a146-25f5-4e48-a49b-0ef6b719685b req-f1829f82-6c44-4ba7-9797-31cca2844133 service nova] Enqueued Resource ID: 23b18f69-8cd7-4633-af71-a07c3e419a19 with Priority: HIGHEST for action port [ 694.236769] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a149f18b-817c-45ab-98f1-e5cc2ba7f60d with Priority: HIGHEST for action security_group_rules [ 694.236769] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a149f18b-817c-45ab-98f1-e5cc2ba7f60d with Priority: HIGHEST for action security_group_members [ 694.236769] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23b18f69-8cd7-4633-af71-a07c3e419a19 with Priority: HIGHEST for action port [ 694.236879] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a149f18b-817c-45ab-98f1-e5cc2ba7f60d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.237398] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a149f18b-817c-45ab-98f1-e5cc2ba7f60d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.238668] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a149f18b-817c-45ab-98f1-e5cc2ba7f60d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.238977] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a149f18b-817c-45ab-98f1-e5cc2ba7f60d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.239266] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a149f18b-817c-45ab-98f1-e5cc2ba7f60d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.244275] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-a149f18b-817c-45ab-98f1-e5cc2ba7f60d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.244275] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a149f18b-817c-45ab-98f1-e5cc2ba7f60d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.244275] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a149f18b-817c-45ab-98f1-e5cc2ba7f60d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.244275] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a149f18b-817c-45ab-98f1-e5cc2ba7f60d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.244275] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.244275] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.244275] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.244275] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.244275] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.244275] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a149f18b-817c-45ab-98f1-e5cc2ba7f60d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.244275] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-23b18f69-8cd7-4633-af71-a07c3e419a19 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.244275] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23b18f69-8cd7-4633-af71-a07c3e419a19" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.244275] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23b18f69-8cd7-4633-af71-a07c3e419a19" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.245098] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23b18f69-8cd7-4633-af71-a07c3e419a19" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.245098] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23b18f69-8cd7-4633-af71-a07c3e419a19',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.332725] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1921ed7c-c558-4eec-9eb2-06038cb54409 [ 694.332725] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.332725] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.332725] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.332725] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.332725] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.332725] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1921ed7c-c558-4eec-9eb2-06038cb54409 already deleted. [ 694.332725] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1921ed7c-c558-4eec-9eb2-06038cb54409" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.566617] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-823c6679-501c-4ec2-9d9f-f49b7cc1205d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.570018] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.570018] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.570018] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.570018] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.570018] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.570018] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.570018] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.570018] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.570018] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.570018] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-823c6679-501c-4ec2-9d9f-f49b7cc1205d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.570018] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.570018] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.570018] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.570018] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.570018] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.574821] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.574821] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.574821] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.574821] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.574821] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('823c6679-501c-4ec2-9d9f-f49b7cc1205d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.741877] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-a149f18b-817c-45ab-98f1-e5cc2ba7f60d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.742065] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a149f18b-817c-45ab-98f1-e5cc2ba7f60d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.750467] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 23b18f69-8cd7-4633-af71-a07c3e419a19 with status ACTIVE [ 694.750733] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.750877] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.750962] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.751229] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.751358] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.751573] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.751681] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.751795] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.751965] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.752018] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.752223] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.752330] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.752392] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.752557] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.752644] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.752730] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 23b18f69-8cd7-4633-af71-a07c3e419a19 is going to be updated. [ 694.753870] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a149f18b-817c-45ab-98f1-e5cc2ba7f60d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.763643] env[69506]: INFO networking_nsxv3.common.synchronization [None req-27b1f4e1-0b52-4610-a292-1ee347c18639 None None] Enqueued Resource ID: 7874ac33-1fc9-48f7-a481-96d10344339b with Priority: HIGHEST for action port [ 694.765261] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7874ac33-1fc9-48f7-a481-96d10344339b with Priority: HIGHEST for action port [ 694.765957] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-7874ac33-1fc9-48f7-a481-96d10344339b taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.766127] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7874ac33-1fc9-48f7-a481-96d10344339b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.766197] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7874ac33-1fc9-48f7-a481-96d10344339b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.766454] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7874ac33-1fc9-48f7-a481-96d10344339b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.766535] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7874ac33-1fc9-48f7-a481-96d10344339b',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.785647] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.785647] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.785647] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.785647] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.785647] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.785647] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23b18f69-8cd7-4633-af71-a07c3e419a19" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.078779] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 823c6679-501c-4ec2-9d9f-f49b7cc1205d: rpc.has_security_group_logging(os_id): False [ 695.094769] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.096761] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.096761] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.096761] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.096761] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.096761] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.096761] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.096761] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.096761] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.096761] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.100121] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.100121] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.100121] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.100121] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.100121] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.100121] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.100121] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.100121] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.100731] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.100912] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.101115] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d is going to be updated. [ 695.156017] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.156368] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.156478] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.156772] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.157057] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.168122] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d in Status: IN_PROGRESS for 2s [ 695.258898] env[69506]: INFO networking_nsxv3.common.synchronization [None req-7c5a9b7c-aaff-41d1-8f67-fa4bec94fbad tempest-ServersTestBootFromVolume-165190847 tempest-ServersTestBootFromVolume-165190847-project-member] Enqueued Resource ID: 9f130eeb-c453-4570-b0fe-743f47890102 with Priority: HIGHEST for action security_group_rules [ 695.258898] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f130eeb-c453-4570-b0fe-743f47890102 with Priority: HIGHEST for action security_group_rules [ 695.258898] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f130eeb-c453-4570-b0fe-743f47890102 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.258898] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f130eeb-c453-4570-b0fe-743f47890102" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.258898] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f130eeb-c453-4570-b0fe-743f47890102" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.258898] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f130eeb-c453-4570-b0fe-743f47890102" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.258898] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f130eeb-c453-4570-b0fe-743f47890102',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.262910] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a149f18b-817c-45ab-98f1-e5cc2ba7f60d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.270248] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7874ac33-1fc9-48f7-a481-96d10344339b [ 695.270248] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.270248] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.270248] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.270248] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.270248] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.270248] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7874ac33-1fc9-48f7-a481-96d10344339b already deleted. [ 695.270248] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7874ac33-1fc9-48f7-a481-96d10344339b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.328322] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bceaf9d-1c44-4281-83d2-4109ac0771c7 in Status: SUCCESS [ 695.328322] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.428533] env[69506]: INFO networking_nsxv3.common.synchronization [None req-c46ee45d-c58c-48d2-9bff-1b5a4bd3e4e7 tempest-ServersTestBootFromVolume-165190847 tempest-ServersTestBootFromVolume-165190847-project-member] Enqueued Resource ID: 9f130eeb-c453-4570-b0fe-743f47890102 with Priority: HIGHEST for action security_group_rules [ 695.429217] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f130eeb-c453-4570-b0fe-743f47890102 with Priority: HIGHEST for action security_group_rules [ 695.429830] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f130eeb-c453-4570-b0fe-743f47890102 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.429830] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f130eeb-c453-4570-b0fe-743f47890102" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.766924] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.767155] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.767228] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.767450] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.767537] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.767649] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a149f18b-817c-45ab-98f1-e5cc2ba7f60d is going to be created. [ 695.782855] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.783032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.785394] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.785394] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.785394] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.785394] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f130eeb-c453-4570-b0fe-743f47890102 already deleted. [ 695.785394] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f130eeb-c453-4570-b0fe-743f47890102" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.785394] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f130eeb-c453-4570-b0fe-743f47890102" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.785394] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f130eeb-c453-4570-b0fe-743f47890102" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.785394] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f130eeb-c453-4570-b0fe-743f47890102',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.791115] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.791256] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.791377] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.791523] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.791691] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.801751] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a149f18b-817c-45ab-98f1-e5cc2ba7f60d in Status: UNINITIALIZED for 2s [ 696.306641] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.307028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.307028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.307153] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.307205] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.307255] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f130eeb-c453-4570-b0fe-743f47890102 already deleted. [ 696.307336] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f130eeb-c453-4570-b0fe-743f47890102" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.950195] env[69506]: INFO networking_nsxv3.common.synchronization [None req-f3ed33d9-1403-4743-991a-0c491d7c014f None None] Enqueued Resource ID: c985c608-bcfc-4813-9206-c5205954ffc6 with Priority: HIGHEST for action port [ 696.950986] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c985c608-bcfc-4813-9206-c5205954ffc6 with Priority: HIGHEST for action port [ 696.952891] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-c985c608-bcfc-4813-9206-c5205954ffc6 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.953155] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c985c608-bcfc-4813-9206-c5205954ffc6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.953376] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c985c608-bcfc-4813-9206-c5205954ffc6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.953628] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c985c608-bcfc-4813-9206-c5205954ffc6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.953822] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c985c608-bcfc-4813-9206-c5205954ffc6',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.055288] env[69506]: INFO networking_nsxv3.common.synchronization [req-e97d97ba-34a3-4f44-9c7c-745ddcae8af4 req-11221ff8-2c8a-4eab-9d0f-8239058a1bb6 tempest-ServersAdminTestJSON-446545879 tempest-ServersAdminTestJSON-446545879-project-member] Enqueued Resource ID: 706a5462-e893-428d-beb2-737cbec00439 with Priority: HIGHEST for action security_group_members [ 697.055785] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 706a5462-e893-428d-beb2-737cbec00439 with Priority: HIGHEST for action security_group_members [ 697.056100] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-706a5462-e893-428d-beb2-737cbec00439 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.056216] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.057355] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.057530] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.057749] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.057861] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.058047] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.058849] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.058948] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.059073] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.186147] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d in Status: SUCCESS [ 697.186281] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.220327] env[69506]: INFO networking_nsxv3.common.synchronization [None req-7a5ed109-d0f7-4a23-b9fb-1de1c15ab002 None None] Enqueued Resource ID: 767c16a9-b21f-4644-af9d-fa1cd9ea3975 with Priority: HIGHEST for action port [ 697.220492] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 767c16a9-b21f-4644-af9d-fa1cd9ea3975 with Priority: HIGHEST for action port [ 697.221043] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-767c16a9-b21f-4644-af9d-fa1cd9ea3975 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.221167] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-767c16a9-b21f-4644-af9d-fa1cd9ea3975" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.221237] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-767c16a9-b21f-4644-af9d-fa1cd9ea3975" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.221640] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-767c16a9-b21f-4644-af9d-fa1cd9ea3975" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.221640] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('767c16a9-b21f-4644-af9d-fa1cd9ea3975',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.455896] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c985c608-bcfc-4813-9206-c5205954ffc6 [ 697.456191] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.456305] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.456358] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.456553] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.456631] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.456731] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c985c608-bcfc-4813-9206-c5205954ffc6 already deleted. [ 697.456806] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c985c608-bcfc-4813-9206-c5205954ffc6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.562479] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.562663] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.562663] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.564780] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.564780] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.564780] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.564780] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.564780] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.564780] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.564780] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.564780] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 706a5462-e893-428d-beb2-737cbec00439 already deleted. [ 697.564780] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.724814] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 767c16a9-b21f-4644-af9d-fa1cd9ea3975 [ 697.725421] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.725693] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.725780] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.726151] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.726151] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.727259] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:767c16a9-b21f-4644-af9d-fa1cd9ea3975 already deleted. [ 697.727259] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-767c16a9-b21f-4644-af9d-fa1cd9ea3975" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.762515] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-149 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.762515] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-149" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.762515] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-149" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.762515] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-149" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.762515] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.762515] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.762515] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.762515] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.762515] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.762515] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 697.762515] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 697.762515] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 697.762515] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 697.763132] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 697.763132] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 697.763132] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 697.781040] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 697.781325] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 697.781503] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 697.781753] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-149" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.782170] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-7c38c1bd-c6ee-44ea-a75a-2ca3cee5817a taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.782403] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-7c38c1bd-c6ee-44ea-a75a-2ca3cee5817a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.782539] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-7c38c1bd-c6ee-44ea-a75a-2ca3cee5817a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.786570] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-7c38c1bd-c6ee-44ea-a75a-2ca3cee5817a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.786570] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c38c1bd-c6ee-44ea-a75a-2ca3cee5817a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.814715] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a149f18b-817c-45ab-98f1-e5cc2ba7f60d in Status: SUCCESS [ 697.815455] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a149f18b-817c-45ab-98f1-e5cc2ba7f60d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.815455] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a149f18b-817c-45ab-98f1-e5cc2ba7f60d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.815455] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a149f18b-817c-45ab-98f1-e5cc2ba7f60d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.817352] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.817352] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.817352] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.817352] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.817352] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.817352] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a149f18b-817c-45ab-98f1-e5cc2ba7f60d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.817352] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a149f18b-817c-45ab-98f1-e5cc2ba7f60d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.288887] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.290558] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.290558] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.290558] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.290558] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.290558] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 7c38c1bd-c6ee-44ea-a75a-2ca3cee5817a not found, creating... [ 698.290558] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.290558] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.290558] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.291643] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.291643] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.291643] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.291643] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.291643] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.291828] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.292921] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.292921] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 7c38c1bd-c6ee-44ea-a75a-2ca3cee5817a is going to be created. [ 698.317394] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.317561] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.317561] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.318614] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.318907] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.319117] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-7c38c1bd-c6ee-44ea-a75a-2ca3cee5817a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.326283] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-a149f18b-817c-45ab-98f1-e5cc2ba7f60d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.326283] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a149f18b-817c-45ab-98f1-e5cc2ba7f60d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.326283] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a149f18b-817c-45ab-98f1-e5cc2ba7f60d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.326283] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a149f18b-817c-45ab-98f1-e5cc2ba7f60d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.326283] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.326283] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.326585] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.326585] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.326661] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.329368] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a149f18b-817c-45ab-98f1-e5cc2ba7f60d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.329368] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-a149f18b-817c-45ab-98f1-e5cc2ba7f60d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.329368] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a149f18b-817c-45ab-98f1-e5cc2ba7f60d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.329368] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a149f18b-817c-45ab-98f1-e5cc2ba7f60d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.329368] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a149f18b-817c-45ab-98f1-e5cc2ba7f60d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.329368] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.329368] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.329368] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.329368] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.329368] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.329368] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a149f18b-817c-45ab-98f1-e5cc2ba7f60d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.329368] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a149f18b-817c-45ab-98f1-e5cc2ba7f60d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.768761] env[69506]: INFO networking_nsxv3.common.synchronization [None req-66bd75b8-555c-4614-a9e9-98473b405717 None None] Enqueued Resource ID: 08b33777-9ad1-4b28-84d8-52727acf2c7b with Priority: HIGHEST for action port [ 698.769045] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08b33777-9ad1-4b28-84d8-52727acf2c7b with Priority: HIGHEST for action port [ 698.769590] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-08b33777-9ad1-4b28-84d8-52727acf2c7b taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.769666] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08b33777-9ad1-4b28-84d8-52727acf2c7b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.769755] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08b33777-9ad1-4b28-84d8-52727acf2c7b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.771323] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08b33777-9ad1-4b28-84d8-52727acf2c7b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.771323] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08b33777-9ad1-4b28-84d8-52727acf2c7b',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.832266] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a149f18b-817c-45ab-98f1-e5cc2ba7f60d: rpc.has_security_group_logging(os_id): False [ 698.849106] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.849336] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.849434] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.849738] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.849833] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.850189] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.850280] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.853485] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.853485] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.853485] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.853485] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.855103] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.855169] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.855418] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.855536] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.855845] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.856012] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.856107] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.856312] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.856421] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.856570] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a149f18b-817c-45ab-98f1-e5cc2ba7f60d is going to be created. [ 698.909274] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.910120] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.910265] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.910530] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.911080] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.925445] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a149f18b-817c-45ab-98f1-e5cc2ba7f60d in Status: IN_PROGRESS for 2s [ 699.163618] env[69506]: INFO networking_nsxv3.common.synchronization [req-e97d97ba-34a3-4f44-9c7c-745ddcae8af4 req-898a7105-78b6-45bb-997e-244c005b2555 service nova] Enqueued Resource ID: 706a5462-e893-428d-beb2-737cbec00439 with Priority: HIGHEST for action security_group_rules [ 699.164440] env[69506]: INFO networking_nsxv3.common.synchronization [req-e97d97ba-34a3-4f44-9c7c-745ddcae8af4 req-898a7105-78b6-45bb-997e-244c005b2555 service nova] Enqueued Resource ID: 706a5462-e893-428d-beb2-737cbec00439 with Priority: HIGHEST for action security_group_members [ 699.164440] env[69506]: INFO networking_nsxv3.common.synchronization [req-e97d97ba-34a3-4f44-9c7c-745ddcae8af4 req-898a7105-78b6-45bb-997e-244c005b2555 service nova] Enqueued Resource ID: 7c38c1bd-c6ee-44ea-a75a-2ca3cee5817a with Priority: HIGHEST for action port [ 699.164782] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 706a5462-e893-428d-beb2-737cbec00439 with Priority: HIGHEST for action security_group_rules [ 699.164966] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 706a5462-e893-428d-beb2-737cbec00439 with Priority: HIGHEST for action security_group_members [ 699.165084] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c38c1bd-c6ee-44ea-a75a-2ca3cee5817a with Priority: HIGHEST for action port [ 699.165362] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-706a5462-e893-428d-beb2-737cbec00439 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.165480] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.165547] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.165863] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.165962] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.166885] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-706a5462-e893-428d-beb2-737cbec00439 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.166993] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.167071] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.167242] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.167386] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.167475] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.167533] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.167674] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.167772] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.167859] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.172531] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c38c1bd-c6ee-44ea-a75a-2ca3cee5817a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.172691] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c38c1bd-c6ee-44ea-a75a-2ca3cee5817a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.172760] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c38c1bd-c6ee-44ea-a75a-2ca3cee5817a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.172946] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c38c1bd-c6ee-44ea-a75a-2ca3cee5817a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.173034] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c38c1bd-c6ee-44ea-a75a-2ca3cee5817a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.273112] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 08b33777-9ad1-4b28-84d8-52727acf2c7b [ 699.273375] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.273513] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.273584] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.274818] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.274818] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.274818] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:08b33777-9ad1-4b28-84d8-52727acf2c7b already deleted. [ 699.274818] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08b33777-9ad1-4b28-84d8-52727acf2c7b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.673391] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.679017] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7c38c1bd-c6ee-44ea-a75a-2ca3cee5817a with status ACTIVE [ 699.679017] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.679017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.679017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.679017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.679017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.679017] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.679017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.679017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.679017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.679017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.679017] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.679017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.679017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.679017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.679017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.679017] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7c38c1bd-c6ee-44ea-a75a-2ca3cee5817a is going to be updated. [ 699.680640] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-706a5462-e893-428d-beb2-737cbec00439 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.680640] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.702263] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.702263] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.702263] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.702645] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.702645] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.702645] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c38c1bd-c6ee-44ea-a75a-2ca3cee5817a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.177433] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.208753] env[69506]: INFO networking_nsxv3.common.synchronization [None req-97f5127e-b431-4a36-9f87-4fcbc4b7f04b None None] Enqueued Resource ID: f290a954-03c6-4966-afb6-2fd2b7bcc425 with Priority: HIGHEST for action port [ 700.209385] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f290a954-03c6-4966-afb6-2fd2b7bcc425 with Priority: HIGHEST for action port [ 700.209669] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-f290a954-03c6-4966-afb6-2fd2b7bcc425 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.209787] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f290a954-03c6-4966-afb6-2fd2b7bcc425" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.209872] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f290a954-03c6-4966-afb6-2fd2b7bcc425" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.210172] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f290a954-03c6-4966-afb6-2fd2b7bcc425" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.210275] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f290a954-03c6-4966-afb6-2fd2b7bcc425',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.680126] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.682225] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.682366] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.682662] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.682776] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.684304] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 706a5462-e893-428d-beb2-737cbec00439 is going to be created. [ 700.710427] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.710590] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.710662] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.710900] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.711092] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.712649] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f290a954-03c6-4966-afb6-2fd2b7bcc425 [ 700.712757] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.715108] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.715108] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.715108] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.715108] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.715108] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f290a954-03c6-4966-afb6-2fd2b7bcc425 already deleted. [ 700.715108] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f290a954-03c6-4966-afb6-2fd2b7bcc425" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.725836] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 706a5462-e893-428d-beb2-737cbec00439 in Status: UNINITIALIZED for 2s [ 700.940376] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a149f18b-817c-45ab-98f1-e5cc2ba7f60d in Status: SUCCESS [ 700.940572] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a149f18b-817c-45ab-98f1-e5cc2ba7f60d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.875061] env[69506]: INFO networking_nsxv3.common.synchronization [req-1f6d9efc-5114-4bd6-9f2f-3b32a679f286 req-23ed65ed-517e-4218-a46f-466c47006b3d tempest-ServersAdminTestJSON-446545879 tempest-ServersAdminTestJSON-446545879-project-member] Enqueued Resource ID: 706a5462-e893-428d-beb2-737cbec00439 with Priority: HIGHEST for action security_group_members [ 701.875061] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 706a5462-e893-428d-beb2-737cbec00439 with Priority: HIGHEST for action security_group_members [ 701.875061] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-706a5462-e893-428d-beb2-737cbec00439 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.875061] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.048211] env[69506]: INFO networking_nsxv3.common.synchronization [None req-cf060733-d4a5-4799-a2cc-d6f61e66169c None None] Enqueued Resource ID: f9684c81-ccbf-4af6-8c6c-2bf970336ec9 with Priority: HIGHEST for action port [ 702.048782] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9684c81-ccbf-4af6-8c6c-2bf970336ec9 with Priority: HIGHEST for action port [ 702.049157] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9684c81-ccbf-4af6-8c6c-2bf970336ec9 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.049318] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9684c81-ccbf-4af6-8c6c-2bf970336ec9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.052438] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9684c81-ccbf-4af6-8c6c-2bf970336ec9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.052533] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9684c81-ccbf-4af6-8c6c-2bf970336ec9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.052637] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9684c81-ccbf-4af6-8c6c-2bf970336ec9',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.271120] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-149 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.271120] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-149" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.271120] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-149" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.271120] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-149" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.271670] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.272041] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.272487] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.272842] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.273132] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.273478] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 702.273722] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 702.273959] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 702.274186] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 702.274406] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 702.275023] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 702.275023] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 702.295347] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 702.295500] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 702.295676] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 702.295822] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-149" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.296153] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-a6b700fb-c5e0-4ec5-a875-a339b7c35de5 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.296325] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-a6b700fb-c5e0-4ec5-a875-a339b7c35de5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.296444] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-a6b700fb-c5e0-4ec5-a875-a339b7c35de5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.296774] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-a6b700fb-c5e0-4ec5-a875-a339b7c35de5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.296924] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6b700fb-c5e0-4ec5-a875-a339b7c35de5',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.554827] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f9684c81-ccbf-4af6-8c6c-2bf970336ec9 [ 702.555188] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.555303] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.555303] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.555516] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.555621] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.555755] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f9684c81-ccbf-4af6-8c6c-2bf970336ec9 already deleted. [ 702.555830] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9684c81-ccbf-4af6-8c6c-2bf970336ec9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.738386] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 706a5462-e893-428d-beb2-737cbec00439 in Status: SUCCESS [ 702.738630] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.739260] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.739260] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.739507] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.739507] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.739608] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.740011] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.740107] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.740176] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.744025] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.744025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.744025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.744025] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.744025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.744025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.744025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.744025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.744025] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.799319] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.799830] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.799984] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.800321] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.800483] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.800897] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port a6b700fb-c5e0-4ec5-a875-a339b7c35de5 not found, creating... [ 702.800975] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.801171] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.801282] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.801513] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.801670] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.802037] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.802282] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.802435] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.802683] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.802860] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.803063] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: a6b700fb-c5e0-4ec5-a875-a339b7c35de5 is going to be created. [ 702.826688] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.826688] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.826688] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.826688] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.826688] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.826688] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-a6b700fb-c5e0-4ec5-a875-a339b7c35de5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.959108] env[69506]: INFO networking_nsxv3.common.synchronization [None req-3fbae636-be6d-4395-b1a2-ba6d821be001 None None] Enqueued Resource ID: 48cbc85e-1ba9-4998-b6c4-4e679c1f212f with Priority: HIGHEST for action port [ 702.959353] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48cbc85e-1ba9-4998-b6c4-4e679c1f212f with Priority: HIGHEST for action port [ 702.959847] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-48cbc85e-1ba9-4998-b6c4-4e679c1f212f taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.959979] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48cbc85e-1ba9-4998-b6c4-4e679c1f212f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.960149] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48cbc85e-1ba9-4998-b6c4-4e679c1f212f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.960937] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48cbc85e-1ba9-4998-b6c4-4e679c1f212f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.961016] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48cbc85e-1ba9-4998-b6c4-4e679c1f212f',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.245864] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-706a5462-e893-428d-beb2-737cbec00439 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.251063] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.251063] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.464841] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 48cbc85e-1ba9-4998-b6c4-4e679c1f212f [ 703.464841] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.464841] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.464841] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.464841] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.464841] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.464841] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:48cbc85e-1ba9-4998-b6c4-4e679c1f212f already deleted. [ 703.464841] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48cbc85e-1ba9-4998-b6c4-4e679c1f212f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.664211] env[69506]: INFO networking_nsxv3.common.synchronization [req-713dc76e-0fa6-4415-b067-ef36e3547f00 req-03f7ae9d-0fda-49d0-9522-0bc2f7d1f74a tempest-ServerMetadataNegativeTestJSON-1368420188 tempest-ServerMetadataNegativeTestJSON-1368420188-project-member] Enqueued Resource ID: 9e830a1e-918a-49a7-b725-f68307282e6e with Priority: HIGHEST for action security_group_members [ 703.664211] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e830a1e-918a-49a7-b725-f68307282e6e with Priority: HIGHEST for action security_group_members [ 703.664211] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e830a1e-918a-49a7-b725-f68307282e6e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.664669] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e830a1e-918a-49a7-b725-f68307282e6e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.664870] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e830a1e-918a-49a7-b725-f68307282e6e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.665214] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e830a1e-918a-49a7-b725-f68307282e6e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.665520] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.665811] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.666035] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.666325] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.667540] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.667540] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e830a1e-918a-49a7-b725-f68307282e6e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.753718] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.069072] env[69506]: INFO networking_nsxv3.common.synchronization [req-1f6d9efc-5114-4bd6-9f2f-3b32a679f286 req-ce3192b0-b34e-4037-b348-da1fe8f7e4f0 service nova] Enqueued Resource ID: 706a5462-e893-428d-beb2-737cbec00439 with Priority: HIGHEST for action security_group_rules [ 704.069072] env[69506]: INFO networking_nsxv3.common.synchronization [req-1f6d9efc-5114-4bd6-9f2f-3b32a679f286 req-ce3192b0-b34e-4037-b348-da1fe8f7e4f0 service nova] Enqueued Resource ID: 706a5462-e893-428d-beb2-737cbec00439 with Priority: HIGHEST for action security_group_members [ 704.069072] env[69506]: INFO networking_nsxv3.common.synchronization [req-1f6d9efc-5114-4bd6-9f2f-3b32a679f286 req-ce3192b0-b34e-4037-b348-da1fe8f7e4f0 service nova] Enqueued Resource ID: a6b700fb-c5e0-4ec5-a875-a339b7c35de5 with Priority: HIGHEST for action port [ 704.069507] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 706a5462-e893-428d-beb2-737cbec00439 with Priority: HIGHEST for action security_group_rules [ 704.069507] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 706a5462-e893-428d-beb2-737cbec00439 with Priority: HIGHEST for action security_group_members [ 704.069586] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6b700fb-c5e0-4ec5-a875-a339b7c35de5 with Priority: HIGHEST for action port [ 704.069822] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-706a5462-e893-428d-beb2-737cbec00439 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.069930] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.071539] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-706a5462-e893-428d-beb2-737cbec00439 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.071539] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.071762] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6b700fb-c5e0-4ec5-a875-a339b7c35de5 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.071762] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6b700fb-c5e0-4ec5-a875-a339b7c35de5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.071762] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6b700fb-c5e0-4ec5-a875-a339b7c35de5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.072053] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6b700fb-c5e0-4ec5-a875-a339b7c35de5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.072053] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6b700fb-c5e0-4ec5-a875-a339b7c35de5',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.115669] env[69506]: INFO networking_nsxv3.common.synchronization [None req-925cb26a-1703-4d36-940c-6cca1a6b968f None None] Enqueued Resource ID: 7c84c701-5d01-4bd2-8e1b-2a7460c70aba with Priority: HIGHEST for action port [ 704.115669] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c84c701-5d01-4bd2-8e1b-2a7460c70aba with Priority: HIGHEST for action port [ 704.115669] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c84c701-5d01-4bd2-8e1b-2a7460c70aba taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.115669] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c84c701-5d01-4bd2-8e1b-2a7460c70aba" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.115669] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c84c701-5d01-4bd2-8e1b-2a7460c70aba" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.117134] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c84c701-5d01-4bd2-8e1b-2a7460c70aba" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.117262] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c84c701-5d01-4bd2-8e1b-2a7460c70aba',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.168582] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.168793] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.168887] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.169120] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.169216] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.169421] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.169519] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.169583] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.169738] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.169872] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.170069] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e830a1e-918a-49a7-b725-f68307282e6e is going to be updated. [ 704.197760] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.198048] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.198131] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.200041] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.200041] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.207883] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e830a1e-918a-49a7-b725-f68307282e6e in Status: IN_PROGRESS for 2s [ 704.257535] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.257760] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.258058] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.258206] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.258395] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.258436] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 706a5462-e893-428d-beb2-737cbec00439 is going to be updated. [ 704.285497] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.285672] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.285753] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.286048] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.286131] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.293699] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 706a5462-e893-428d-beb2-737cbec00439 in Status: IN_PROGRESS for 2s [ 704.576222] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a6b700fb-c5e0-4ec5-a875-a339b7c35de5 with status ACTIVE [ 704.576222] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.576222] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.576222] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.576222] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.576222] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.576476] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.576476] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.576476] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.576717] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.576717] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.576904] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.576991] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.577089] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.577240] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.577296] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.577392] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a6b700fb-c5e0-4ec5-a875-a339b7c35de5 is going to be updated. [ 704.601951] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.601951] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.601951] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.601951] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.601951] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.601951] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6b700fb-c5e0-4ec5-a875-a339b7c35de5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.620396] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7c84c701-5d01-4bd2-8e1b-2a7460c70aba [ 704.620930] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.622166] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.622166] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.622166] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.622166] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.622166] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7c84c701-5d01-4bd2-8e1b-2a7460c70aba already deleted. [ 704.622166] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c84c701-5d01-4bd2-8e1b-2a7460c70aba" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.185219] env[69506]: INFO networking_nsxv3.common.synchronization [None req-68dc49c1-b6e2-4e39-af81-49cc45b0568b None None] Enqueued Resource ID: 2592d117-9491-4125-8e1d-5808ecb8aaf9 with Priority: HIGHEST for action port [ 705.185550] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2592d117-9491-4125-8e1d-5808ecb8aaf9 with Priority: HIGHEST for action port [ 705.186454] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-2592d117-9491-4125-8e1d-5808ecb8aaf9 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.186885] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2592d117-9491-4125-8e1d-5808ecb8aaf9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.187042] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2592d117-9491-4125-8e1d-5808ecb8aaf9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.187329] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2592d117-9491-4125-8e1d-5808ecb8aaf9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.187718] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2592d117-9491-4125-8e1d-5808ecb8aaf9',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.689829] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2592d117-9491-4125-8e1d-5808ecb8aaf9 [ 705.690101] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.690263] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.690335] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.690545] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.690633] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.690762] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2592d117-9491-4125-8e1d-5808ecb8aaf9 already deleted. [ 705.690857] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2592d117-9491-4125-8e1d-5808ecb8aaf9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.221882] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e830a1e-918a-49a7-b725-f68307282e6e in Status: SUCCESS [ 706.222711] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e830a1e-918a-49a7-b725-f68307282e6e deletion is rescheduled due to dependency. [ 706.223491] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e830a1e-918a-49a7-b725-f68307282e6e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.276254] env[69506]: INFO networking_nsxv3.common.synchronization [req-6a8799bf-5ce5-4777-a21b-2a3f2592ca4d req-3ae6c1c2-62b8-4d8a-b830-4b4842e41ad9 tempest-ImagesTestJSON-821230832 tempest-ImagesTestJSON-821230832-project-member] Enqueued Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_members [ 706.276915] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_members [ 706.277282] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0db323-2ed4-4f6a-a30a-405b16133cb2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.277422] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.277520] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.277868] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.278060] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.278182] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.278233] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.278414] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.278578] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.278637] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.303749] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 706a5462-e893-428d-beb2-737cbec00439 in Status: SUCCESS [ 706.304042] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.304736] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.304998] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.305204] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.305328] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.305386] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.305598] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.305715] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.305715] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.305872] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-706a5462-e893-428d-beb2-737cbec00439 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.305964] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.306042] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.306844] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.306844] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.306941] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.306980] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.307130] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.307212] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.307297] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.307396] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.308751] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.308904] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.309126] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.309224] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.309340] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.309515] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.309598] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.309693] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.558791] env[69506]: INFO networking_nsxv3.common.synchronization [None req-16149d9a-1ae1-427b-9f29-b77998706a52 None None] Enqueued Resource ID: b2214ad5-8852-4575-84fd-1b2c2ee4be96 with Priority: HIGHEST for action port [ 706.558791] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2214ad5-8852-4575-84fd-1b2c2ee4be96 with Priority: HIGHEST for action port [ 706.559220] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2214ad5-8852-4575-84fd-1b2c2ee4be96 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.559337] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2214ad5-8852-4575-84fd-1b2c2ee4be96" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.559401] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2214ad5-8852-4575-84fd-1b2c2ee4be96" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.560327] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2214ad5-8852-4575-84fd-1b2c2ee4be96" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.560327] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2214ad5-8852-4575-84fd-1b2c2ee4be96',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.640321] env[69506]: INFO networking_nsxv3.common.synchronization [req-48125ab0-74db-4eff-8af6-d30ea7ef8238 req-9a7e2b7c-aef7-4f3c-9a9a-53b195ecb6b6 tempest-ServerExternalEventsTest-645571710 tempest-ServerExternalEventsTest-645571710-project-member] Enqueued Resource ID: a149f18b-817c-45ab-98f1-e5cc2ba7f60d with Priority: HIGHEST for action security_group_members [ 706.640796] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a149f18b-817c-45ab-98f1-e5cc2ba7f60d with Priority: HIGHEST for action security_group_members [ 706.641109] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-a149f18b-817c-45ab-98f1-e5cc2ba7f60d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.641226] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a149f18b-817c-45ab-98f1-e5cc2ba7f60d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.641291] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a149f18b-817c-45ab-98f1-e5cc2ba7f60d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.641491] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a149f18b-817c-45ab-98f1-e5cc2ba7f60d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.641640] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.641736] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.641806] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.641967] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.645022] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.645022] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a149f18b-817c-45ab-98f1-e5cc2ba7f60d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.780416] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.780416] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.780596] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.780711] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.780804] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.781018] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.781131] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.781192] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.781350] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.781428] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.781513] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 already deleted. [ 706.781596] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.807321] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-612 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.807860] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-612" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.807860] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-612" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.808064] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-612" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.808559] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.808559] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.808733] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.808897] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.809700] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.809700] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 706.809700] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 706.809949] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 706.809990] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 706.810702] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 706.810702] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 706.810702] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 706.812563] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 706a5462-e893-428d-beb2-737cbec00439: rpc.has_security_group_logging(os_id): False [ 706.813491] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.838156] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 706.838331] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 706.838469] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 706.838648] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-612" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.838998] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-32f4c29a-9f9f-44c7-a926-1cf9b1ccb48f taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.839205] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-32f4c29a-9f9f-44c7-a926-1cf9b1ccb48f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.839327] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-32f4c29a-9f9f-44c7-a926-1cf9b1ccb48f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.839644] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-32f4c29a-9f9f-44c7-a926-1cf9b1ccb48f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.839783] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32f4c29a-9f9f-44c7-a926-1cf9b1ccb48f',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.842065] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.842376] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.842495] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.842720] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.842850] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.843117] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.843246] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.843397] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.843820] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.843820] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.843820] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.844019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.844159] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.844353] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.844466] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.844741] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.844893] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.844993] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.845234] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.845375] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.845504] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 706a5462-e893-428d-beb2-737cbec00439 is going to be created. [ 706.910280] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.910515] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.910622] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.910861] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.911087] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.922898] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 706a5462-e893-428d-beb2-737cbec00439 in Status: IN_PROGRESS for 2s [ 707.069990] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b2214ad5-8852-4575-84fd-1b2c2ee4be96 [ 707.069990] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.069990] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.069990] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.069990] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.069990] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.069990] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b2214ad5-8852-4575-84fd-1b2c2ee4be96 already deleted. [ 707.069990] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2214ad5-8852-4575-84fd-1b2c2ee4be96" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.145269] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.145471] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.145558] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.145794] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.145899] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.146155] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.146266] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.146327] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.146504] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.146784] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.146917] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a149f18b-817c-45ab-98f1-e5cc2ba7f60d is going to be updated. [ 707.174583] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.175114] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.175114] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.175114] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.175386] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.184990] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a149f18b-817c-45ab-98f1-e5cc2ba7f60d in Status: IN_PROGRESS for 2s [ 707.315963] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.344824] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.344824] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.344824] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.344824] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.344824] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.344824] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 32f4c29a-9f9f-44c7-a926-1cf9b1ccb48f not found, creating... [ 707.344824] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.344824] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.346533] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.346533] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.346533] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.346533] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.346533] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.346533] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.346533] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.346874] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.346874] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 32f4c29a-9f9f-44c7-a926-1cf9b1ccb48f is going to be created. [ 707.369945] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.370192] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.370318] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.370597] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.370824] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.371155] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-32f4c29a-9f9f-44c7-a926-1cf9b1ccb48f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.822869] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.822869] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.822869] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.822869] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.822869] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.822869] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 706a5462-e893-428d-beb2-737cbec00439 is going to be updated. [ 707.848809] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.848809] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.848809] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.848809] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.848809] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.858512] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 706a5462-e893-428d-beb2-737cbec00439 in Status: IN_PROGRESS for 2s [ 708.338755] env[69506]: INFO networking_nsxv3.common.synchronization [req-6a8799bf-5ce5-4777-a21b-2a3f2592ca4d req-a04b758b-40e1-431e-bf56-712236b3c2f5 service nova] Enqueued Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_rules [ 708.338947] env[69506]: INFO networking_nsxv3.common.synchronization [req-6a8799bf-5ce5-4777-a21b-2a3f2592ca4d req-a04b758b-40e1-431e-bf56-712236b3c2f5 service nova] Enqueued Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_members [ 708.339107] env[69506]: INFO networking_nsxv3.common.synchronization [req-6a8799bf-5ce5-4777-a21b-2a3f2592ca4d req-a04b758b-40e1-431e-bf56-712236b3c2f5 service nova] Enqueued Resource ID: 32f4c29a-9f9f-44c7-a926-1cf9b1ccb48f with Priority: HIGHEST for action port [ 708.339351] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_rules [ 708.339482] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_members [ 708.339576] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32f4c29a-9f9f-44c7-a926-1cf9b1ccb48f with Priority: HIGHEST for action port [ 708.340906] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d0db323-2ed4-4f6a-a30a-405b16133cb2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.341060] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.341133] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.341384] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.341476] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.342384] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0db323-2ed4-4f6a-a30a-405b16133cb2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.342493] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.342565] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.342798] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.343040] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.343179] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.343248] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.343436] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.343546] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.343640] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.345810] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-32f4c29a-9f9f-44c7-a926-1cf9b1ccb48f taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.345918] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32f4c29a-9f9f-44c7-a926-1cf9b1ccb48f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.345986] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32f4c29a-9f9f-44c7-a926-1cf9b1ccb48f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.346159] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32f4c29a-9f9f-44c7-a926-1cf9b1ccb48f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.346235] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32f4c29a-9f9f-44c7-a926-1cf9b1ccb48f',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.850531] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.852131] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0db323-2ed4-4f6a-a30a-405b16133cb2 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.852131] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.852131] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 32f4c29a-9f9f-44c7-a926-1cf9b1ccb48f with status ACTIVE [ 708.852131] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.852131] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.852131] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.852502] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.852502] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.852653] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.852653] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.852739] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.852966] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.852966] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.853192] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.854858] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.854858] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.854858] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.854858] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.854858] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 32f4c29a-9f9f-44c7-a926-1cf9b1ccb48f is going to be updated. [ 708.872934] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.873105] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.873175] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.874647] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.874647] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.874647] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32f4c29a-9f9f-44c7-a926-1cf9b1ccb48f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.942885] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 706a5462-e893-428d-beb2-737cbec00439 in Status: SUCCESS [ 708.943107] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.943434] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.943496] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.943899] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.195851] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a149f18b-817c-45ab-98f1-e5cc2ba7f60d in Status: SUCCESS [ 709.196078] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a149f18b-817c-45ab-98f1-e5cc2ba7f60d deletion is rescheduled due to dependency. [ 709.196200] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a149f18b-817c-45ab-98f1-e5cc2ba7f60d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.355531] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.447940] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-706a5462-e893-428d-beb2-737cbec00439 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.448147] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.858803] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.858963] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.859050] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.859275] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.859362] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.859459] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 is going to be created. [ 709.870257] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 706a5462-e893-428d-beb2-737cbec00439 in Status: SUCCESS [ 709.870556] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.870794] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.871108] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.871380] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.871957] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.871957] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.871957] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.872225] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.872225] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.872293] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.884500] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.884659] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.884753] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.884992] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.885236] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.893552] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: UNINITIALIZED for 2s [ 710.374616] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-706a5462-e893-428d-beb2-737cbec00439 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.374955] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.374955] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.375357] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.375752] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.375987] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.376125] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.376328] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.376463] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.376598] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.376803] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-706a5462-e893-428d-beb2-737cbec00439 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.376977] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.377240] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.381022] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.381022] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.381022] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.381022] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.381022] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.381022] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.381022] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.381022] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.469985] env[69506]: INFO networking_nsxv3.common.synchronization [req-06055ca5-a081-48b1-8221-2e4b96eca81c req-1465ff44-1a31-47dc-a9e7-62747cadba1c tempest-FloatingIPsAssociationTestJSON-642147526 tempest-FloatingIPsAssociationTestJSON-642147526-project-member] Enqueued Resource ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 with Priority: HIGHEST for action security_group_members [ 710.470436] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 with Priority: HIGHEST for action security_group_members [ 710.470738] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-56c2fe94-2993-4f31-a331-b0611a88cec2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.470882] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.470956] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.471788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.471933] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.471992] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.472048] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.472179] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.472265] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.472362] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56c2fe94-2993-4f31-a331-b0611a88cec2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.886645] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 706a5462-e893-428d-beb2-737cbec00439: rpc.has_security_group_logging(os_id): False [ 710.903953] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.904281] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.904281] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.904612] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.904681] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.904880] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.904996] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.905095] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.905263] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.905344] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.905533] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.905627] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.905687] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.905843] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.905906] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.906946] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.907097] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.907178] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.907357] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.907442] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.907534] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 706a5462-e893-428d-beb2-737cbec00439 is going to be updated. [ 710.969698] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.969855] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.969974] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.970156] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.970287] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.973828] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('56c2fe94-2993-4f31-a331-b0611a88cec2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.983170] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 706a5462-e893-428d-beb2-737cbec00439 in Status: IN_PROGRESS for 2s [ 711.026723] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-176 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.026723] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-176" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.026723] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-176" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.026723] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-176" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.026723] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.026723] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.026723] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.026723] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.026723] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.027196] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 711.027196] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 711.027196] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 711.027196] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 711.027335] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 711.027371] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 711.027733] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 711.071290] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 711.071500] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.044 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 711.071663] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 711.071894] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-176" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.072488] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-576b248c-c6a5-4bec-93a7-b913e0377132 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.072741] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-576b248c-c6a5-4bec-93a7-b913e0377132" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.072877] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-576b248c-c6a5-4bec-93a7-b913e0377132" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.073228] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-576b248c-c6a5-4bec-93a7-b913e0377132" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.073373] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('576b248c-c6a5-4bec-93a7-b913e0377132',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.476069] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('56c2fe94-2993-4f31-a331-b0611a88cec2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.576590] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.576794] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.576921] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.577224] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.577822] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.577822] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 576b248c-c6a5-4bec-93a7-b913e0377132 not found, creating... [ 711.578530] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.578530] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.578530] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.578937] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.579172] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.579502] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.579709] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.579977] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.580299] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.580470] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.580680] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 576b248c-c6a5-4bec-93a7-b913e0377132 is going to be created. [ 711.598346] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.598578] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.598702] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.598966] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.599475] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.599708] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-576b248c-c6a5-4bec-93a7-b913e0377132" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.905415] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: SUCCESS [ 711.905415] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.905415] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.905415] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.905415] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.905415] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.905415] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.905415] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.905415] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.905415] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.905415] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.985781] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.985781] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.985781] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.985781] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.985781] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.985781] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 is going to be updated. [ 712.011939] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.011939] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.011939] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.011939] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.011939] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.018659] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 in Status: IN_PROGRESS for 2s [ 712.277729] env[69506]: INFO networking_nsxv3.common.synchronization [None req-e804f767-ebf8-48cf-a400-d87c4cf4cedf None None] Enqueued Resource ID: 4187837a-8c32-40e5-8eb7-7067a6fa227d with Priority: HIGHEST for action port [ 712.278014] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4187837a-8c32-40e5-8eb7-7067a6fa227d with Priority: HIGHEST for action port [ 712.278586] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-4187837a-8c32-40e5-8eb7-7067a6fa227d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.278710] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4187837a-8c32-40e5-8eb7-7067a6fa227d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.278781] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4187837a-8c32-40e5-8eb7-7067a6fa227d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.283265] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4187837a-8c32-40e5-8eb7-7067a6fa227d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.283381] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4187837a-8c32-40e5-8eb7-7067a6fa227d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.338485] env[69506]: INFO networking_nsxv3.common.synchronization [req-06055ca5-a081-48b1-8221-2e4b96eca81c req-2c05ca28-eec3-48a7-bb51-58e03e30f141 service nova] Enqueued Resource ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 with Priority: HIGHEST for action security_group_rules [ 712.338485] env[69506]: INFO networking_nsxv3.common.synchronization [req-06055ca5-a081-48b1-8221-2e4b96eca81c req-2c05ca28-eec3-48a7-bb51-58e03e30f141 service nova] Enqueued Resource ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 with Priority: HIGHEST for action security_group_members [ 712.338485] env[69506]: INFO networking_nsxv3.common.synchronization [req-06055ca5-a081-48b1-8221-2e4b96eca81c req-2c05ca28-eec3-48a7-bb51-58e03e30f141 service nova] Enqueued Resource ID: 576b248c-c6a5-4bec-93a7-b913e0377132 with Priority: HIGHEST for action port [ 712.338485] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 with Priority: HIGHEST for action security_group_rules [ 712.338485] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 with Priority: HIGHEST for action security_group_members [ 712.338485] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 576b248c-c6a5-4bec-93a7-b913e0377132 with Priority: HIGHEST for action port [ 712.338485] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-56c2fe94-2993-4f31-a331-b0611a88cec2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.338485] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.338485] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.339121] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.339326] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('56c2fe94-2993-4f31-a331-b0611a88cec2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.344027] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-56c2fe94-2993-4f31-a331-b0611a88cec2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.344027] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.344027] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-576b248c-c6a5-4bec-93a7-b913e0377132 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.344027] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-576b248c-c6a5-4bec-93a7-b913e0377132" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.344027] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-576b248c-c6a5-4bec-93a7-b913e0377132" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.344027] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-576b248c-c6a5-4bec-93a7-b913e0377132" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.344027] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('576b248c-c6a5-4bec-93a7-b913e0377132',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.406992] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0db323-2ed4-4f6a-a30a-405b16133cb2 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.407222] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.407298] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.407526] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.407698] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.407865] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.407945] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.408117] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.408205] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.408296] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.408441] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0db323-2ed4-4f6a-a30a-405b16133cb2 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.408534] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.408594] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.408731] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.408895] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.409021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.409095] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.409237] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.409312] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.409392] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.410875] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.786484] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4187837a-8c32-40e5-8eb7-7067a6fa227d [ 712.787622] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.787622] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.787622] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.787622] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.787622] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.787622] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4187837a-8c32-40e5-8eb7-7067a6fa227d already deleted. [ 712.787622] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4187837a-8c32-40e5-8eb7-7067a6fa227d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.842846] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-56c2fe94-2993-4f31-a331-b0611a88cec2 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.842846] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.849308] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 576b248c-c6a5-4bec-93a7-b913e0377132 with status ACTIVE [ 712.849308] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.849308] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.849308] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.849308] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.849308] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.849308] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.849308] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.849308] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.850143] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.851803] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.851803] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.851803] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.851803] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.851803] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.851803] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.851803] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 576b248c-c6a5-4bec-93a7-b913e0377132 is going to be updated. [ 712.874050] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.874050] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.874050] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.874050] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.874050] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.874050] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-576b248c-c6a5-4bec-93a7-b913e0377132" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.913943] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d0db323-2ed4-4f6a-a30a-405b16133cb2: rpc.has_security_group_logging(os_id): False [ 712.931629] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.932493] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.932681] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.933082] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.933220] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.933358] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.933594] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.933594] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.933708] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.933772] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.933962] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.937447] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.937447] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.937447] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.937447] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.937703] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.937703] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.937703] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.937950] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.937950] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.938027] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 is going to be created. [ 713.005075] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 706a5462-e893-428d-beb2-737cbec00439 in Status: SUCCESS [ 713.005075] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.008354] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.008656] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.008656] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.008856] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.009036] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.027115] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: IN_PROGRESS for 2s [ 713.142917] env[69506]: INFO networking_nsxv3.common.synchronization [req-38732972-b2ba-47a6-9b1d-a2e477173760 req-371ab920-0612-4ad9-8657-2ece2c1d5ea0 tempest-DeleteServersAdminTestJSON-537793646 tempest-DeleteServersAdminTestJSON-537793646-project-member] Enqueued Resource ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 with Priority: HIGHEST for action security_group_members [ 713.143503] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 with Priority: HIGHEST for action security_group_members [ 713.143848] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.143996] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.144099] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.144328] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.144522] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.144624] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.144697] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.144868] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.144970] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.145112] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.633222] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-438 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.633398] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.633577] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.633846] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.634794] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.634977] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.635150] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.635478] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.635643] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.635866] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 713.635983] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 713.636106] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 713.636218] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 713.636329] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 713.636469] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 713.636564] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 713.647841] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.648426] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.648426] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.648426] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.648426] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.648616] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.648752] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.648841] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.649066] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.649181] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.649297] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 is going to be updated. [ 713.654264] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 713.654488] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 713.654663] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 713.654876] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.655433] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-4b254cc6-58fc-4568-b2a5-57900b02f4aa taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.655503] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-4b254cc6-58fc-4568-b2a5-57900b02f4aa" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.655633] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-4b254cc6-58fc-4568-b2a5-57900b02f4aa" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.655956] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-4b254cc6-58fc-4568-b2a5-57900b02f4aa" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.656126] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b254cc6-58fc-4568-b2a5-57900b02f4aa',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.671832] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.672076] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.672207] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.672467] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.672653] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.686173] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 in Status: IN_PROGRESS for 2s [ 714.028142] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 in Status: SUCCESS [ 714.028431] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.028530] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.028747] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.028942] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.029076] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.029141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.029295] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.029378] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.029484] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56c2fe94-2993-4f31-a331-b0611a88cec2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.090050] env[69506]: INFO networking_nsxv3.common.synchronization [req-4fa98729-c825-4bf2-8c6d-ef10cc63386c req-8723dd19-9441-40ae-8e56-1e47298b0e0f tempest-ListServerFiltersTestJSON-2708404 tempest-ListServerFiltersTestJSON-2708404-project-member] Enqueued Resource ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d with Priority: HIGHEST for action security_group_members [ 714.090614] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d with Priority: HIGHEST for action security_group_members [ 714.090913] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-823c6679-501c-4ec2-9d9f-f49b7cc1205d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.091047] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.091118] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.092024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.092024] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.092024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.092024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.092024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.092024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.092024] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('823c6679-501c-4ec2-9d9f-f49b7cc1205d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.159186] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.159485] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.159642] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.159975] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.160195] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.160366] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 4b254cc6-58fc-4568-b2a5-57900b02f4aa not found, creating... [ 714.160645] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.160810] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.160926] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.161174] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.161312] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.161601] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.161763] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.161865] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.162086] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.162218] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.162354] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 4b254cc6-58fc-4568-b2a5-57900b02f4aa is going to be created. [ 714.181476] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.181681] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.181803] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.182118] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.182345] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.182581] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-4b254cc6-58fc-4568-b2a5-57900b02f4aa" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.508527] env[69506]: INFO networking_nsxv3.common.synchronization [None req-a59d3ac4-9084-4057-a3db-a87d038f518e None None] Enqueued Resource ID: e22cc52a-0540-473b-816e-ba37ad98a29b with Priority: HIGHEST for action port [ 714.508790] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e22cc52a-0540-473b-816e-ba37ad98a29b with Priority: HIGHEST for action port [ 714.509437] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-e22cc52a-0540-473b-816e-ba37ad98a29b taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.509560] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e22cc52a-0540-473b-816e-ba37ad98a29b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.509994] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e22cc52a-0540-473b-816e-ba37ad98a29b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.509994] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e22cc52a-0540-473b-816e-ba37ad98a29b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.510085] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e22cc52a-0540-473b-816e-ba37ad98a29b',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.532246] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('56c2fe94-2993-4f31-a331-b0611a88cec2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.595289] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('823c6679-501c-4ec2-9d9f-f49b7cc1205d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.015033] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e22cc52a-0540-473b-816e-ba37ad98a29b [ 715.015033] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.015033] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.015033] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.015033] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.015033] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.015033] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e22cc52a-0540-473b-816e-ba37ad98a29b already deleted. [ 715.015033] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e22cc52a-0540-473b-816e-ba37ad98a29b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.015443] env[69506]: INFO networking_nsxv3.common.synchronization [req-38732972-b2ba-47a6-9b1d-a2e477173760 req-bf98923a-df36-4c50-8885-5d970c293c22 service nova] Enqueued Resource ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 with Priority: HIGHEST for action security_group_rules [ 715.015538] env[69506]: INFO networking_nsxv3.common.synchronization [req-38732972-b2ba-47a6-9b1d-a2e477173760 req-bf98923a-df36-4c50-8885-5d970c293c22 service nova] Enqueued Resource ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 with Priority: HIGHEST for action security_group_members [ 715.015704] env[69506]: INFO networking_nsxv3.common.synchronization [req-38732972-b2ba-47a6-9b1d-a2e477173760 req-bf98923a-df36-4c50-8885-5d970c293c22 service nova] Enqueued Resource ID: 4b254cc6-58fc-4568-b2a5-57900b02f4aa with Priority: HIGHEST for action port [ 715.015868] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 with Priority: HIGHEST for action security_group_rules [ 715.016010] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 with Priority: HIGHEST for action security_group_members [ 715.016234] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b254cc6-58fc-4568-b2a5-57900b02f4aa with Priority: HIGHEST for action port [ 715.016654] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.016770] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.016838] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.017033] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.017136] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.018601] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.018601] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.018601] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b254cc6-58fc-4568-b2a5-57900b02f4aa taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.018601] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b254cc6-58fc-4568-b2a5-57900b02f4aa" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.018601] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b254cc6-58fc-4568-b2a5-57900b02f4aa" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.018601] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b254cc6-58fc-4568-b2a5-57900b02f4aa" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.019085] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b254cc6-58fc-4568-b2a5-57900b02f4aa',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.036758] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('56c2fe94-2993-4f31-a331-b0611a88cec2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.039475] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: SUCCESS [ 715.039730] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.096998] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('823c6679-501c-4ec2-9d9f-f49b7cc1205d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.520945] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.521162] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.521516] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4b254cc6-58fc-4568-b2a5-57900b02f4aa with status ACTIVE [ 715.521768] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.521896] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.521986] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.522307] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.522451] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.522706] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.522976] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.522976] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.523332] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.523332] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.523600] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.523740] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.523884] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.524107] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.524251] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.524875] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4b254cc6-58fc-4568-b2a5-57900b02f4aa is going to be updated. [ 715.539173] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.539427] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.539558] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.539886] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.540070] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.540239] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 is going to be updated. [ 715.550623] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.550782] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.550885] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.551163] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.551337] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.551544] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b254cc6-58fc-4568-b2a5-57900b02f4aa" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.567152] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.567152] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.567152] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.567431] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.567431] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.576042] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 in Status: IN_PROGRESS for 2s [ 715.600876] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.601018] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.601086] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.601682] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.601803] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.601879] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d is going to be updated. [ 715.633038] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.633038] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.633038] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.633038] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.633038] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.680063] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d in Status: IN_PROGRESS for 2s [ 715.716171] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 in Status: SUCCESS [ 715.716443] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 deletion is rescheduled due to dependency. [ 715.716591] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.716850] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.717189] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.718791] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.718923] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.718990] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.719217] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.719308] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.719413] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.230024] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.726081] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.228789] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.229017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.229111] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.229339] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.229467] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.229577] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 is going to be updated. [ 717.262115] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.262452] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.262452] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.262635] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.262771] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.272046] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 in Status: IN_PROGRESS for 2s [ 717.588396] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 in Status: SUCCESS [ 717.588619] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.589063] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.589063] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.589235] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.589627] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.589627] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.589627] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.589627] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.589730] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.589884] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('56c2fe94-2993-4f31-a331-b0611a88cec2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.670873] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d in Status: SUCCESS [ 717.670873] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.095841] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-56c2fe94-2993-4f31-a331-b0611a88cec2 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.096900] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.096900] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.097463] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.097463] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.097463] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.097625] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.097774] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.097927] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.098112] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.098307] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-56c2fe94-2993-4f31-a331-b0611a88cec2 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.098440] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.098530] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.098705] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.098901] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.099050] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.099140] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.099307] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.099417] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.099530] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.099651] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('56c2fe94-2993-4f31-a331-b0611a88cec2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.602049] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 56c2fe94-2993-4f31-a331-b0611a88cec2: rpc.has_security_group_logging(os_id): False [ 718.636216] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.636409] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.636482] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.636742] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.636831] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.637124] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.637199] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.637276] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.638039] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.638039] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.638039] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.638039] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.638039] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.638387] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.638387] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.638481] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.638548] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.638599] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.638771] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.638851] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.638940] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 is going to be updated. [ 718.701270] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.701424] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.701497] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.701877] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.701877] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.721111] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 in Status: IN_PROGRESS for 2s [ 718.939185] env[69506]: INFO networking_nsxv3.common.synchronization [req-caafaafb-cf2b-4aaa-bacb-9202b8be0f3c req-771fae97-1360-4307-8357-b3baa5c450f7 tempest-ServerDiskConfigTestJSON-583020681 tempest-ServerDiskConfigTestJSON-583020681-project-member] Enqueued Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_members [ 718.939552] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_members [ 718.939900] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-008501d4-938b-4336-9c1d-ef3665f7d09d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.940013] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.942456] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.942693] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.942879] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.942993] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.943338] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.943338] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.943338] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.943483] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.254049] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-350 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.254049] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-350" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.254049] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-350" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.254262] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-350" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.254431] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.255738] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.255738] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.255738] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.255738] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.255738] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 719.255738] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 719.255738] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 719.255738] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 719.256123] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 719.256123] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 719.256123] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 719.275967] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 719.276257] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 719.276410] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 719.276621] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-350" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.276983] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-f08e13eb-4d39-4942-8698-7eae608f0afb taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.277192] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-f08e13eb-4d39-4942-8698-7eae608f0afb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.277325] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-f08e13eb-4d39-4942-8698-7eae608f0afb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.277685] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-f08e13eb-4d39-4942-8698-7eae608f0afb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.277840] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f08e13eb-4d39-4942-8698-7eae608f0afb',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.287102] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 in Status: SUCCESS [ 719.287336] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.287509] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.287727] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.287952] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.288100] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.288173] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.288347] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.288425] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.288509] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.288601] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.445347] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.445585] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.445585] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.445783] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.445982] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.446486] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.446486] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.446486] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.446698] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.446698] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.446698] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 008501d4-938b-4336-9c1d-ef3665f7d09d is going to be updated. [ 719.472903] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.472903] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.472903] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.472903] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.472903] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.482311] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 008501d4-938b-4336-9c1d-ef3665f7d09d in Status: IN_PROGRESS for 2s [ 719.780234] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.780478] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.780570] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.780844] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.781012] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.781177] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port f08e13eb-4d39-4942-8698-7eae608f0afb not found, creating... [ 719.781429] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.781589] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.781708] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.781932] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.782116] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.782419] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.782562] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.782678] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.782887] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.783034] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.783176] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: f08e13eb-4d39-4942-8698-7eae608f0afb is going to be created. [ 719.794148] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.794299] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.794299] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.794470] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.794605] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.794810] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.794901] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.795308] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.795418] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.795492] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.795647] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.795747] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.795810] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.796045] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.796290] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.796290] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.796365] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.796488] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.796569] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.796652] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.796744] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.804426] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.804426] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.804426] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.804426] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.804426] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.804693] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-f08e13eb-4d39-4942-8698-7eae608f0afb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.300077] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5: rpc.has_security_group_logging(os_id): False [ 720.320037] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.320037] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.320037] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.320037] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.320037] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.320037] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.320037] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.320037] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.320358] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.320358] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.320611] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.320611] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.320611] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.320736] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.320770] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.321691] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.321691] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.321691] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.321691] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.321691] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.321922] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 is going to be updated. [ 720.384105] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.384275] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.384349] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.384571] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.384711] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.397787] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 in Status: IN_PROGRESS for 2s [ 720.716914] env[69506]: INFO networking_nsxv3.common.synchronization [req-caafaafb-cf2b-4aaa-bacb-9202b8be0f3c req-b8afb156-b457-4eec-a275-14614cd33aed service nova] Enqueued Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_rules [ 720.717202] env[69506]: INFO networking_nsxv3.common.synchronization [req-caafaafb-cf2b-4aaa-bacb-9202b8be0f3c req-b8afb156-b457-4eec-a275-14614cd33aed service nova] Enqueued Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_members [ 720.717250] env[69506]: INFO networking_nsxv3.common.synchronization [req-caafaafb-cf2b-4aaa-bacb-9202b8be0f3c req-b8afb156-b457-4eec-a275-14614cd33aed service nova] Enqueued Resource ID: f08e13eb-4d39-4942-8698-7eae608f0afb with Priority: HIGHEST for action port [ 720.718030] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_rules [ 720.718030] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_members [ 720.718030] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f08e13eb-4d39-4942-8698-7eae608f0afb with Priority: HIGHEST for action port [ 720.718223] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-008501d4-938b-4336-9c1d-ef3665f7d09d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.718343] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.718414] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.718616] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.718697] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.720221] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-008501d4-938b-4336-9c1d-ef3665f7d09d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.720317] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.720519] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-f08e13eb-4d39-4942-8698-7eae608f0afb taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.720623] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f08e13eb-4d39-4942-8698-7eae608f0afb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.720690] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f08e13eb-4d39-4942-8698-7eae608f0afb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.720866] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f08e13eb-4d39-4942-8698-7eae608f0afb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.720941] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f08e13eb-4d39-4942-8698-7eae608f0afb',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.737031] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 in Status: SUCCESS [ 720.737676] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.223998] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-008501d4-938b-4336-9c1d-ef3665f7d09d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.223998] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.223998] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f08e13eb-4d39-4942-8698-7eae608f0afb with status ACTIVE [ 721.223998] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.223998] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.223998] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.223998] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.224442] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.224442] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.224442] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.224442] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.224567] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.224668] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.225147] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.225147] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.225147] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.225420] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.225420] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.225420] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f08e13eb-4d39-4942-8698-7eae608f0afb is going to be updated. [ 721.251055] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.251055] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.251055] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.251055] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.251055] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.251055] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f08e13eb-4d39-4942-8698-7eae608f0afb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.267250] env[69506]: INFO networking_nsxv3.common.synchronization [None req-678f0bd6-3af9-4701-bb40-d79e95c5b5e2 None None] Enqueued Resource ID: 66d243a7-0a77-4326-9aeb-d70ce4a0d7c5 with Priority: HIGHEST for action port [ 721.267250] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66d243a7-0a77-4326-9aeb-d70ce4a0d7c5 with Priority: HIGHEST for action port [ 721.267250] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-66d243a7-0a77-4326-9aeb-d70ce4a0d7c5 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.267250] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66d243a7-0a77-4326-9aeb-d70ce4a0d7c5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.267250] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66d243a7-0a77-4326-9aeb-d70ce4a0d7c5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.267250] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66d243a7-0a77-4326-9aeb-d70ce4a0d7c5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.267250] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66d243a7-0a77-4326-9aeb-d70ce4a0d7c5',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.492708] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 008501d4-938b-4336-9c1d-ef3665f7d09d in Status: SUCCESS [ 721.495021] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 008501d4-938b-4336-9c1d-ef3665f7d09d deletion is rescheduled due to dependency. [ 721.495021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.495021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.495021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.495021] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.495021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.495021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.495021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.495021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.495021] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.770111] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 66d243a7-0a77-4326-9aeb-d70ce4a0d7c5 [ 721.770111] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.770111] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.770111] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.770341] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.770341] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.770411] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:66d243a7-0a77-4326-9aeb-d70ce4a0d7c5 already deleted. [ 721.770653] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66d243a7-0a77-4326-9aeb-d70ce4a0d7c5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.888256] env[69506]: INFO networking_nsxv3.common.synchronization [req-82a8a81b-d1aa-4f24-9b59-9abfe4fc271c req-a953de26-9ce1-470f-a8d1-f43a60db6728 tempest-ServerDiagnosticsTest-1919427399 tempest-ServerDiagnosticsTest-1919427399-project-member] Enqueued Resource ID: 7d665e3e-5768-414e-b88d-89e23ff633e1 with Priority: HIGHEST for action security_group_members [ 721.888778] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d665e3e-5768-414e-b88d-89e23ff633e1 with Priority: HIGHEST for action security_group_members [ 721.889369] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d665e3e-5768-414e-b88d-89e23ff633e1 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.889369] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d665e3e-5768-414e-b88d-89e23ff633e1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.889369] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d665e3e-5768-414e-b88d-89e23ff633e1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.889578] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d665e3e-5768-414e-b88d-89e23ff633e1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.890923] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.891336] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.892154] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.892295] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.892397] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.892488] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d665e3e-5768-414e-b88d-89e23ff633e1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.000556] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.397093] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.397371] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.397371] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.397667] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.397788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.398056] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.400974] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.400974] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.400974] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.400974] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.400974] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d665e3e-5768-414e-b88d-89e23ff633e1 already deleted. [ 722.400974] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d665e3e-5768-414e-b88d-89e23ff633e1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.412188] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 in Status: SUCCESS [ 722.412477] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.461596] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-438 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.461824] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.462309] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.462309] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.462932] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.463133] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.463275] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.463518] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.463728] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.463970] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 722.464208] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 722.464346] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 722.464460] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 722.464594] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 722.464698] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 722.464848] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 722.483762] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 722.484535] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 722.484535] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 722.484535] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.488359] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-6c224ee4-3e42-4da2-8735-cb5a5f7ffc73 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.488620] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-6c224ee4-3e42-4da2-8735-cb5a5f7ffc73" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.488761] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-6c224ee4-3e42-4da2-8735-cb5a5f7ffc73" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.489340] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-6c224ee4-3e42-4da2-8735-cb5a5f7ffc73" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.489402] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c224ee4-3e42-4da2-8735-cb5a5f7ffc73',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.504482] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.992111] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.992340] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.992485] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.992778] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.992931] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.993108] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 6c224ee4-3e42-4da2-8735-cb5a5f7ffc73 not found, creating... [ 722.993398] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.993560] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.993679] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.993911] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.994075] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.994366] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.994825] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.994825] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.994959] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.995968] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.996179] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 6c224ee4-3e42-4da2-8735-cb5a5f7ffc73 is going to be created. [ 723.006741] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.006871] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.006932] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.007738] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.007738] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.007738] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 008501d4-938b-4336-9c1d-ef3665f7d09d is going to be updated. [ 723.016728] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.017260] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.017802] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.018130] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.018366] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.018594] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-6c224ee4-3e42-4da2-8735-cb5a5f7ffc73" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.053067] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.053222] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.053286] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.053507] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.053649] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.077853] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 008501d4-938b-4336-9c1d-ef3665f7d09d in Status: IN_PROGRESS for 2s [ 723.173154] env[69506]: INFO networking_nsxv3.common.synchronization [None req-902c55b1-07be-4ed9-82b6-caf90216d289 None None] Enqueued Resource ID: d7309a24-119e-4412-b087-af37499ee9c7 with Priority: HIGHEST for action port [ 723.173154] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7309a24-119e-4412-b087-af37499ee9c7 with Priority: HIGHEST for action port [ 723.173808] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7309a24-119e-4412-b087-af37499ee9c7 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.174169] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7309a24-119e-4412-b087-af37499ee9c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.174609] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7309a24-119e-4412-b087-af37499ee9c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.175217] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7309a24-119e-4412-b087-af37499ee9c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.175608] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7309a24-119e-4412-b087-af37499ee9c7',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.679183] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d7309a24-119e-4412-b087-af37499ee9c7 [ 723.679485] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.679566] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.679635] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.679850] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.679942] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.680055] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d7309a24-119e-4412-b087-af37499ee9c7 already deleted. [ 723.680134] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7309a24-119e-4412-b087-af37499ee9c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.100398] env[69506]: INFO networking_nsxv3.common.synchronization [req-82a8a81b-d1aa-4f24-9b59-9abfe4fc271c req-5cf3fac3-7ed4-43cf-b685-be099860ede0 service nova] Enqueued Resource ID: 7d665e3e-5768-414e-b88d-89e23ff633e1 with Priority: HIGHEST for action security_group_rules [ 724.100502] env[69506]: INFO networking_nsxv3.common.synchronization [req-82a8a81b-d1aa-4f24-9b59-9abfe4fc271c req-5cf3fac3-7ed4-43cf-b685-be099860ede0 service nova] Enqueued Resource ID: 7d665e3e-5768-414e-b88d-89e23ff633e1 with Priority: HIGHEST for action security_group_members [ 724.100640] env[69506]: INFO networking_nsxv3.common.synchronization [req-82a8a81b-d1aa-4f24-9b59-9abfe4fc271c req-5cf3fac3-7ed4-43cf-b685-be099860ede0 service nova] Enqueued Resource ID: 6c224ee4-3e42-4da2-8735-cb5a5f7ffc73 with Priority: HIGHEST for action port [ 724.100972] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d665e3e-5768-414e-b88d-89e23ff633e1 with Priority: HIGHEST for action security_group_rules [ 724.101026] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d665e3e-5768-414e-b88d-89e23ff633e1 with Priority: HIGHEST for action security_group_members [ 724.101112] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c224ee4-3e42-4da2-8735-cb5a5f7ffc73 with Priority: HIGHEST for action port [ 724.101709] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d665e3e-5768-414e-b88d-89e23ff633e1 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.101817] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d665e3e-5768-414e-b88d-89e23ff633e1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.101883] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d665e3e-5768-414e-b88d-89e23ff633e1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.102211] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d665e3e-5768-414e-b88d-89e23ff633e1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.102289] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d665e3e-5768-414e-b88d-89e23ff633e1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.103165] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d665e3e-5768-414e-b88d-89e23ff633e1 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.103274] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d665e3e-5768-414e-b88d-89e23ff633e1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.103338] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d665e3e-5768-414e-b88d-89e23ff633e1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.103524] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d665e3e-5768-414e-b88d-89e23ff633e1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.103672] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.103788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.103841] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.103990] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.104090] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.104179] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d665e3e-5768-414e-b88d-89e23ff633e1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.105124] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c224ee4-3e42-4da2-8735-cb5a5f7ffc73 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.105124] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c224ee4-3e42-4da2-8735-cb5a5f7ffc73" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.105254] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c224ee4-3e42-4da2-8735-cb5a5f7ffc73" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.105481] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c224ee4-3e42-4da2-8735-cb5a5f7ffc73" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.105563] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c224ee4-3e42-4da2-8735-cb5a5f7ffc73',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.123035] env[69506]: INFO networking_nsxv3.common.synchronization [req-46f2ada0-3434-401a-b2db-f9f7b400a4a8 req-f050215f-f6ed-47a9-8bd5-30e1f1d5db80 tempest-InstanceActionsNegativeTestJSON-1732575951 tempest-InstanceActionsNegativeTestJSON-1732575951-project-member] Enqueued Resource ID: 386ab661-7bf3-4005-884c-cf906d5c497b with Priority: HIGHEST for action security_group_members [ 724.123035] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 386ab661-7bf3-4005-884c-cf906d5c497b with Priority: HIGHEST for action security_group_members [ 724.123505] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-386ab661-7bf3-4005-884c-cf906d5c497b taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.123639] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-386ab661-7bf3-4005-884c-cf906d5c497b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.123698] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-386ab661-7bf3-4005-884c-cf906d5c497b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.123951] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-386ab661-7bf3-4005-884c-cf906d5c497b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.124123] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.124226] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.124558] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.124558] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.124558] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.124744] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('386ab661-7bf3-4005-884c-cf906d5c497b',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.517642] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-481 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.517900] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-481" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.518013] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-481" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.518371] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-481" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.518644] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.518840] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.518943] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.519232] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.519464] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.520255] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 724.520255] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 724.520255] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 724.520255] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 724.520255] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 724.520524] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 724.520524] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 724.539597] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 724.540220] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 724.540220] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 724.540220] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-481" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.540450] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-8c98f896-f4d3-4c93-bf9f-54e14325dba8 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.540630] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-8c98f896-f4d3-4c93-bf9f-54e14325dba8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.540751] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-8c98f896-f4d3-4c93-bf9f-54e14325dba8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.541154] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-8c98f896-f4d3-4c93-bf9f-54e14325dba8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.541307] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c98f896-f4d3-4c93-bf9f-54e14325dba8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.611549] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d665e3e-5768-414e-b88d-89e23ff633e1 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.611934] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d665e3e-5768-414e-b88d-89e23ff633e1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.612242] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d665e3e-5768-414e-b88d-89e23ff633e1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.613375] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6c224ee4-3e42-4da2-8735-cb5a5f7ffc73 with status ACTIVE [ 724.613863] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.615022] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.615022] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.615022] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.615022] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.615022] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.615022] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.615022] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.615022] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.615668] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.616020] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.616258] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.616401] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.618339] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.618339] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.618339] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6c224ee4-3e42-4da2-8735-cb5a5f7ffc73 is going to be updated. [ 724.627461] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.627461] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.627461] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.627629] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.627629] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.627877] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.627962] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.628408] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.628408] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.628489] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.629035] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 386ab661-7bf3-4005-884c-cf906d5c497b already deleted. [ 724.629035] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-386ab661-7bf3-4005-884c-cf906d5c497b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.637177] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.637659] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.637659] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.637659] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.637659] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.637811] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c224ee4-3e42-4da2-8735-cb5a5f7ffc73" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.043524] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.043939] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.043939] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.044188] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.044340] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.044499] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 8c98f896-f4d3-4c93-bf9f-54e14325dba8 not found, creating... [ 725.044771] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.044929] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.045104] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.045296] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.045577] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.045714] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.045917] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.046068] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.046284] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.046417] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.046636] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 8c98f896-f4d3-4c93-bf9f-54e14325dba8 is going to be created. [ 725.066646] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.067332] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.067332] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.067332] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.067700] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.067700] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-8c98f896-f4d3-4c93-bf9f-54e14325dba8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.086483] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 008501d4-938b-4336-9c1d-ef3665f7d09d in Status: SUCCESS [ 725.086715] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.086895] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.087142] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.087341] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.087463] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.087530] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.087690] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.087773] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.087861] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.088012] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.119211] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d665e3e-5768-414e-b88d-89e23ff633e1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.596981] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-008501d4-938b-4336-9c1d-ef3665f7d09d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.597246] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.597246] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.597469] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.597640] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.597738] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.597803] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.597966] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.598089] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.598186] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.598335] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-008501d4-938b-4336-9c1d-ef3665f7d09d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.598426] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.598488] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.598634] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.598770] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.601456] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.601456] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.601456] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.601456] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.601456] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.601456] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.621366] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.621685] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.621685] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.622095] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.622095] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.622095] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d665e3e-5768-414e-b88d-89e23ff633e1 is going to be created. [ 725.651016] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.651016] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.651016] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.651016] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.651016] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.659292] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d665e3e-5768-414e-b88d-89e23ff633e1 in Status: UNINITIALIZED for 2s [ 725.896638] env[69506]: INFO networking_nsxv3.common.synchronization [req-46f2ada0-3434-401a-b2db-f9f7b400a4a8 req-d76cf40a-8ca2-4f4c-a7f6-b94716cfb9a5 service nova] Enqueued Resource ID: 386ab661-7bf3-4005-884c-cf906d5c497b with Priority: HIGHEST for action security_group_rules [ 725.896872] env[69506]: INFO networking_nsxv3.common.synchronization [req-46f2ada0-3434-401a-b2db-f9f7b400a4a8 req-d76cf40a-8ca2-4f4c-a7f6-b94716cfb9a5 service nova] Enqueued Resource ID: 386ab661-7bf3-4005-884c-cf906d5c497b with Priority: HIGHEST for action security_group_members [ 725.898326] env[69506]: INFO networking_nsxv3.common.synchronization [req-46f2ada0-3434-401a-b2db-f9f7b400a4a8 req-d76cf40a-8ca2-4f4c-a7f6-b94716cfb9a5 service nova] Enqueued Resource ID: 8c98f896-f4d3-4c93-bf9f-54e14325dba8 with Priority: HIGHEST for action port [ 725.898326] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 386ab661-7bf3-4005-884c-cf906d5c497b with Priority: HIGHEST for action security_group_rules [ 725.898326] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 386ab661-7bf3-4005-884c-cf906d5c497b with Priority: HIGHEST for action security_group_members [ 725.898326] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c98f896-f4d3-4c93-bf9f-54e14325dba8 with Priority: HIGHEST for action port [ 725.900318] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-386ab661-7bf3-4005-884c-cf906d5c497b taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.900604] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-386ab661-7bf3-4005-884c-cf906d5c497b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.900757] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-386ab661-7bf3-4005-884c-cf906d5c497b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.901345] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-386ab661-7bf3-4005-884c-cf906d5c497b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.903116] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('386ab661-7bf3-4005-884c-cf906d5c497b',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.904154] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-386ab661-7bf3-4005-884c-cf906d5c497b taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.904426] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-386ab661-7bf3-4005-884c-cf906d5c497b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.904426] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-386ab661-7bf3-4005-884c-cf906d5c497b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.904730] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-386ab661-7bf3-4005-884c-cf906d5c497b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.905264] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.905264] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.905264] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.905461] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.905596] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.905735] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('386ab661-7bf3-4005-884c-cf906d5c497b',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.907947] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c98f896-f4d3-4c93-bf9f-54e14325dba8 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.908661] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c98f896-f4d3-4c93-bf9f-54e14325dba8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.908661] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c98f896-f4d3-4c93-bf9f-54e14325dba8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.909368] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c98f896-f4d3-4c93-bf9f-54e14325dba8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.909368] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c98f896-f4d3-4c93-bf9f-54e14325dba8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.103029] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 008501d4-938b-4336-9c1d-ef3665f7d09d: rpc.has_security_group_logging(os_id): False [ 726.120808] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.121075] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.121163] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.121438] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.121939] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.121939] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.121939] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.121939] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.122155] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.122270] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.122655] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.122655] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.122655] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.122849] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.122849] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.122990] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.123069] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.123134] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.123269] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.123394] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.123479] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 008501d4-938b-4336-9c1d-ef3665f7d09d is going to be updated. [ 726.271062] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.271062] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.271062] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.271062] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.271415] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.293854] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 008501d4-938b-4336-9c1d-ef3665f7d09d in Status: IN_PROGRESS for 2s [ 726.410828] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-386ab661-7bf3-4005-884c-cf906d5c497b taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.410984] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-386ab661-7bf3-4005-884c-cf906d5c497b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.412954] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('386ab661-7bf3-4005-884c-cf906d5c497b',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.413611] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8c98f896-f4d3-4c93-bf9f-54e14325dba8 with status ACTIVE [ 726.414382] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.414553] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.414662] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.415257] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.415257] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.415440] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.416194] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.416194] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.416194] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.416194] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.416334] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.416424] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.416507] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.416685] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.416781] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.416892] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8c98f896-f4d3-4c93-bf9f-54e14325dba8 is going to be updated. [ 726.453292] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.453465] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.453519] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.453706] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.454665] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.454665] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c98f896-f4d3-4c93-bf9f-54e14325dba8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.919532] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('386ab661-7bf3-4005-884c-cf906d5c497b',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.348799] env[69506]: INFO networking_nsxv3.common.synchronization [req-5b9c1339-ec27-4d4a-aa9c-98778bc17efa req-6c8481ea-ca77-4705-9638-b5b5a5e94cf1 tempest-DeleteServersAdminTestJSON-537793646 tempest-DeleteServersAdminTestJSON-537793646-project-member] Enqueued Resource ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 with Priority: HIGHEST for action security_group_members [ 727.350525] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 with Priority: HIGHEST for action security_group_members [ 727.350525] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.350525] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.350525] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.350525] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.350525] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.350953] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.350953] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.351049] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.351184] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.351273] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.422612] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.422803] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.422906] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.423215] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.423327] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.423491] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 386ab661-7bf3-4005-884c-cf906d5c497b is going to be created. [ 727.451025] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.451025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.451025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.451025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.451025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.460028] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 386ab661-7bf3-4005-884c-cf906d5c497b in Status: UNINITIALIZED for 2s [ 727.670330] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d665e3e-5768-414e-b88d-89e23ff633e1 in Status: SUCCESS [ 727.670671] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d665e3e-5768-414e-b88d-89e23ff633e1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.670731] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d665e3e-5768-414e-b88d-89e23ff633e1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.670928] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d665e3e-5768-414e-b88d-89e23ff633e1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.671218] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.671319] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.671364] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.671549] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.671662] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.671753] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d665e3e-5768-414e-b88d-89e23ff633e1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.671816] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d665e3e-5768-414e-b88d-89e23ff633e1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.857084] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.857084] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.857084] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.857084] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.857084] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.857084] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.857395] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.857395] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.857447] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.858535] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.858535] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 is going to be updated. [ 727.886550] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.886738] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.886806] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.886980] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.887510] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.897549] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 in Status: IN_PROGRESS for 2s [ 727.941244] env[69506]: INFO networking_nsxv3.common.synchronization [req-49f8dffd-4038-40db-940a-e07f40a4848c req-7c3ce0aa-b957-4460-84f7-58625c3b94c5 tempest-ServerActionsTestOtherB-347258904 tempest-ServerActionsTestOtherB-347258904-project-member] Enqueued Resource ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 with Priority: HIGHEST for action security_group_members [ 727.942479] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 with Priority: HIGHEST for action security_group_members [ 727.942968] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.943403] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.943594] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.944327] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.945073] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.945285] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.945425] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.945692] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.946113] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.947566] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fca9cd47-c1fb-4023-8f12-fa1b22a98fd8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.180020] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d665e3e-5768-414e-b88d-89e23ff633e1 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.180020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d665e3e-5768-414e-b88d-89e23ff633e1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.180020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d665e3e-5768-414e-b88d-89e23ff633e1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.180020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d665e3e-5768-414e-b88d-89e23ff633e1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.180020] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.180020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.180020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.180020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.180020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.180020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d665e3e-5768-414e-b88d-89e23ff633e1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.180020] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d665e3e-5768-414e-b88d-89e23ff633e1 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.180020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d665e3e-5768-414e-b88d-89e23ff633e1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.180020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d665e3e-5768-414e-b88d-89e23ff633e1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.180020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d665e3e-5768-414e-b88d-89e23ff633e1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.180020] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.180020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.180612] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.180612] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.180612] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.180612] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d665e3e-5768-414e-b88d-89e23ff633e1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.180612] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d665e3e-5768-414e-b88d-89e23ff633e1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.308495] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 008501d4-938b-4336-9c1d-ef3665f7d09d in Status: SUCCESS [ 728.308495] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.450292] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.450608] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.450608] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.450754] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.450847] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.451061] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.451162] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.451222] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.451380] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.451458] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.451543] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 already deleted. [ 728.451622] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.682015] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d665e3e-5768-414e-b88d-89e23ff633e1: rpc.has_security_group_logging(os_id): False [ 728.699044] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.699239] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.699325] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.699576] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.699675] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.699875] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.700014] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.700088] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.700268] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.700355] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.700590] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.700688] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.700753] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.700902] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.701454] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.701454] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.701454] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.701454] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.701615] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.701615] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.701741] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d665e3e-5768-414e-b88d-89e23ff633e1 is going to be created. [ 728.710948] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-697 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.712507] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-697" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.712507] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-697" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.712507] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-697" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.712507] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.712507] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.714177] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.714177] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.714177] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.714177] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 728.714177] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 728.714177] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 728.714177] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 728.714177] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 728.714461] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 728.714461] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 728.731471] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 728.731637] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 728.731777] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 728.731950] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-697" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.732330] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-73f0d27f-5db7-41b9-a80d-3d8af4695b6a taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.732512] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-73f0d27f-5db7-41b9-a80d-3d8af4695b6a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.732634] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-73f0d27f-5db7-41b9-a80d-3d8af4695b6a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.732945] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-73f0d27f-5db7-41b9-a80d-3d8af4695b6a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.733098] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73f0d27f-5db7-41b9-a80d-3d8af4695b6a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.757508] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.757700] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.757700] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.759904] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.759904] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.768213] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d665e3e-5768-414e-b88d-89e23ff633e1 in Status: IN_PROGRESS for 2s [ 728.871150] env[69506]: INFO networking_nsxv3.common.synchronization [req-6689f2cd-f345-40ee-a946-c3c9aa9acfdb req-b1d92e85-9297-4e63-9788-82ba1517b57b tempest-FloatingIPsAssociationTestJSON-642147526 tempest-FloatingIPsAssociationTestJSON-642147526-project-member] Enqueued Resource ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 with Priority: HIGHEST for action security_group_members [ 728.871665] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 with Priority: HIGHEST for action security_group_members [ 728.871964] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-56c2fe94-2993-4f31-a331-b0611a88cec2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.872097] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.872158] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.872564] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.872564] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.872680] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.872680] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.872779] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.872859] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.872953] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56c2fe94-2993-4f31-a331-b0611a88cec2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.236228] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.236718] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.236994] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.237521] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.237716] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.237920] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 73f0d27f-5db7-41b9-a80d-3d8af4695b6a not found, creating... [ 729.238667] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.238887] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.239187] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.239496] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.240164] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.240164] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.240164] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.240318] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.240636] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.240878] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.241455] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 73f0d27f-5db7-41b9-a80d-3d8af4695b6a is going to be created. [ 729.264357] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.264617] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.264688] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.264978] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.265230] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.269025] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-73f0d27f-5db7-41b9-a80d-3d8af4695b6a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.375012] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('56c2fe94-2993-4f31-a331-b0611a88cec2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.471212] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 386ab661-7bf3-4005-884c-cf906d5c497b in Status: SUCCESS [ 729.471541] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-386ab661-7bf3-4005-884c-cf906d5c497b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.471632] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-386ab661-7bf3-4005-884c-cf906d5c497b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.471847] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-386ab661-7bf3-4005-884c-cf906d5c497b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.472060] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.472227] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.472286] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.472399] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.472484] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.472571] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-386ab661-7bf3-4005-884c-cf906d5c497b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.472663] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('386ab661-7bf3-4005-884c-cf906d5c497b',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.878821] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('56c2fe94-2993-4f31-a331-b0611a88cec2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.907469] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 in Status: SUCCESS [ 729.907603] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 deletion is rescheduled due to dependency. [ 729.907689] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.975260] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-386ab661-7bf3-4005-884c-cf906d5c497b taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.975428] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-386ab661-7bf3-4005-884c-cf906d5c497b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.975504] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-386ab661-7bf3-4005-884c-cf906d5c497b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.975735] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-386ab661-7bf3-4005-884c-cf906d5c497b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.976019] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.976150] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.976216] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.976377] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.976467] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.976557] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-386ab661-7bf3-4005-884c-cf906d5c497b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.976706] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-386ab661-7bf3-4005-884c-cf906d5c497b taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.976818] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-386ab661-7bf3-4005-884c-cf906d5c497b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.976854] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-386ab661-7bf3-4005-884c-cf906d5c497b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.976989] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-386ab661-7bf3-4005-884c-cf906d5c497b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.977141] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.977231] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.977291] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.977426] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.977501] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.977580] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-386ab661-7bf3-4005-884c-cf906d5c497b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.977668] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('386ab661-7bf3-4005-884c-cf906d5c497b',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.036808] env[69506]: INFO networking_nsxv3.common.synchronization [req-49f8dffd-4038-40db-940a-e07f40a4848c req-9c4e1a62-c4f1-4652-b0a5-56238632c9eb service nova] Enqueued Resource ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 with Priority: HIGHEST for action security_group_rules [ 730.037050] env[69506]: INFO networking_nsxv3.common.synchronization [req-49f8dffd-4038-40db-940a-e07f40a4848c req-9c4e1a62-c4f1-4652-b0a5-56238632c9eb service nova] Enqueued Resource ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 with Priority: HIGHEST for action security_group_members [ 730.037212] env[69506]: INFO networking_nsxv3.common.synchronization [req-49f8dffd-4038-40db-940a-e07f40a4848c req-9c4e1a62-c4f1-4652-b0a5-56238632c9eb service nova] Enqueued Resource ID: 73f0d27f-5db7-41b9-a80d-3d8af4695b6a with Priority: HIGHEST for action port [ 730.037492] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 with Priority: HIGHEST for action security_group_rules [ 730.037663] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 with Priority: HIGHEST for action security_group_members [ 730.037804] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73f0d27f-5db7-41b9-a80d-3d8af4695b6a with Priority: HIGHEST for action port [ 730.038474] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.038693] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.038693] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.038824] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.038853] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fca9cd47-c1fb-4023-8f12-fa1b22a98fd8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.039964] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.039964] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.039964] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.040114] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.041952] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.042079] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.042162] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.042298] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.042380] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.042476] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fca9cd47-c1fb-4023-8f12-fa1b22a98fd8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.043243] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-73f0d27f-5db7-41b9-a80d-3d8af4695b6a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.045756] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73f0d27f-5db7-41b9-a80d-3d8af4695b6a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.045756] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73f0d27f-5db7-41b9-a80d-3d8af4695b6a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.045756] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73f0d27f-5db7-41b9-a80d-3d8af4695b6a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.045756] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73f0d27f-5db7-41b9-a80d-3d8af4695b6a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.383861] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.383861] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.383861] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.383861] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.383861] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.383861] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 is going to be updated. [ 730.408823] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.409020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.409245] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.409415] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.409474] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.417859] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 in Status: IN_PROGRESS for 2s [ 730.480771] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 386ab661-7bf3-4005-884c-cf906d5c497b: rpc.has_security_group_logging(os_id): False [ 730.497929] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.498161] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.498233] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.498473] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.498576] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.498844] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.498940] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.499015] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.499495] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.499495] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.499495] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.499632] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.499632] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.499752] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.499800] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.499961] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.500067] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.500123] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.500295] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.500397] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.500488] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 386ab661-7bf3-4005-884c-cf906d5c497b is going to be created. [ 730.545820] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.545969] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.546286] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fca9cd47-c1fb-4023-8f12-fa1b22a98fd8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.547459] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 73f0d27f-5db7-41b9-a80d-3d8af4695b6a with status ACTIVE [ 730.547537] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.547660] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.547726] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.547984] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.548162] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.548782] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.548782] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.548782] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.548782] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.549018] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.549152] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.549229] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.549382] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.549660] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.549660] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.549660] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 73f0d27f-5db7-41b9-a80d-3d8af4695b6a is going to be updated. [ 730.559924] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.559924] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.559924] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.559924] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.559924] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.571413] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.572685] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.572685] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.572685] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.572685] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.572990] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73f0d27f-5db7-41b9-a80d-3d8af4695b6a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.574436] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 386ab661-7bf3-4005-884c-cf906d5c497b in Status: IN_PROGRESS for 2s [ 730.781211] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d665e3e-5768-414e-b88d-89e23ff633e1 in Status: SUCCESS [ 730.782165] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d665e3e-5768-414e-b88d-89e23ff633e1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.052187] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fca9cd47-c1fb-4023-8f12-fa1b22a98fd8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.555526] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.556140] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.556140] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.556140] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.556140] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.556365] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 is going to be created. [ 731.578770] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.578770] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.578770] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.579117] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.579322] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.588336] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 in Status: UNINITIALIZED for 2s [ 732.433712] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 in Status: SUCCESS [ 732.433944] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.585881] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 386ab661-7bf3-4005-884c-cf906d5c497b in Status: SUCCESS [ 732.586212] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-386ab661-7bf3-4005-884c-cf906d5c497b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.830598] env[69506]: INFO networking_nsxv3.common.synchronization [req-3a19a890-7aa0-4e4a-9533-005e3722a4fe req-4403e866-cdf9-4a31-b30c-8ed1e4f08ca8 tempest-ServerAddressesTestJSON-1737983309 tempest-ServerAddressesTestJSON-1737983309-project-member] Enqueued Resource ID: 39f6b94d-d05c-4309-8b06-e27ba3215b09 with Priority: HIGHEST for action security_group_members [ 732.831110] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39f6b94d-d05c-4309-8b06-e27ba3215b09 with Priority: HIGHEST for action security_group_members [ 732.831622] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-39f6b94d-d05c-4309-8b06-e27ba3215b09 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.831622] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39f6b94d-d05c-4309-8b06-e27ba3215b09" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.831622] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39f6b94d-d05c-4309-8b06-e27ba3215b09" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.832208] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39f6b94d-d05c-4309-8b06-e27ba3215b09" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.832208] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.832768] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.832768] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.832867] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.832895] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.833018] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39f6b94d-d05c-4309-8b06-e27ba3215b09',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.302964] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-216 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.303117] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-216" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.303117] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-216" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.303456] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-216" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.303718] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.303879] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.303997] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.304405] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.304557] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.304769] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 733.304884] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 733.304994] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 733.305143] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 733.305298] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 733.305350] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 733.305466] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 733.322950] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 733.323383] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 733.323383] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 733.323612] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-216" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.323997] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-fdb8c1f0-2434-4bb9-8de4-4b4f8d630d5a taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.324251] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-fdb8c1f0-2434-4bb9-8de4-4b4f8d630d5a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.324423] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-fdb8c1f0-2434-4bb9-8de4-4b4f8d630d5a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.324780] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-fdb8c1f0-2434-4bb9-8de4-4b4f8d630d5a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.324953] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fdb8c1f0-2434-4bb9-8de4-4b4f8d630d5a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.335274] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.335433] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.335591] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.335743] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.335743] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.335953] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.336124] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.336305] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.336390] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.336480] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.336570] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39f6b94d-d05c-4309-8b06-e27ba3215b09 already deleted. [ 733.336652] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39f6b94d-d05c-4309-8b06-e27ba3215b09" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.600248] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 in Status: SUCCESS [ 733.600564] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.601154] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.601485] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.601750] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.601934] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.602067] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.602298] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.602429] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.602546] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.602678] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fca9cd47-c1fb-4023-8f12-fa1b22a98fd8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.828224] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.828516] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.828677] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.829437] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.829637] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.829833] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port fdb8c1f0-2434-4bb9-8de4-4b4f8d630d5a not found, creating... [ 733.830192] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.830388] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.830562] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.830860] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.832150] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.832150] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.832150] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.832150] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.832150] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.832425] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.832425] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: fdb8c1f0-2434-4bb9-8de4-4b4f8d630d5a is going to be created. [ 733.850600] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.850826] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.850957] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.851300] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.851491] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.851730] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-fdb8c1f0-2434-4bb9-8de4-4b4f8d630d5a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.105329] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fca9cd47-c1fb-4023-8f12-fa1b22a98fd8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.608519] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fca9cd47-c1fb-4023-8f12-fa1b22a98fd8: rpc.has_security_group_logging(os_id): False [ 734.633896] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.633896] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.633896] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.633896] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.633896] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.633896] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.633896] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.633896] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.633896] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.633896] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.633896] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 is going to be created. [ 734.677413] env[69506]: INFO networking_nsxv3.common.synchronization [req-3a19a890-7aa0-4e4a-9533-005e3722a4fe req-6c5887bf-7399-4c98-a873-2de33ef015ac service nova] Enqueued Resource ID: 39f6b94d-d05c-4309-8b06-e27ba3215b09 with Priority: HIGHEST for action security_group_rules [ 734.677611] env[69506]: INFO networking_nsxv3.common.synchronization [req-3a19a890-7aa0-4e4a-9533-005e3722a4fe req-6c5887bf-7399-4c98-a873-2de33ef015ac service nova] Enqueued Resource ID: 39f6b94d-d05c-4309-8b06-e27ba3215b09 with Priority: HIGHEST for action security_group_members [ 734.677781] env[69506]: INFO networking_nsxv3.common.synchronization [req-3a19a890-7aa0-4e4a-9533-005e3722a4fe req-6c5887bf-7399-4c98-a873-2de33ef015ac service nova] Enqueued Resource ID: fdb8c1f0-2434-4bb9-8de4-4b4f8d630d5a with Priority: HIGHEST for action port [ 734.678822] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39f6b94d-d05c-4309-8b06-e27ba3215b09 with Priority: HIGHEST for action security_group_rules [ 734.679034] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39f6b94d-d05c-4309-8b06-e27ba3215b09 with Priority: HIGHEST for action security_group_members [ 734.679241] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdb8c1f0-2434-4bb9-8de4-4b4f8d630d5a with Priority: HIGHEST for action port [ 734.679592] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39f6b94d-d05c-4309-8b06-e27ba3215b09 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.679796] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39f6b94d-d05c-4309-8b06-e27ba3215b09" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.679921] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39f6b94d-d05c-4309-8b06-e27ba3215b09" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.680285] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39f6b94d-d05c-4309-8b06-e27ba3215b09" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.680423] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39f6b94d-d05c-4309-8b06-e27ba3215b09',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.681490] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-39f6b94d-d05c-4309-8b06-e27ba3215b09 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.682297] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39f6b94d-d05c-4309-8b06-e27ba3215b09" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.682297] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39f6b94d-d05c-4309-8b06-e27ba3215b09" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.682297] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39f6b94d-d05c-4309-8b06-e27ba3215b09" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.682297] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.682297] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.682297] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.682571] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.682571] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.683215] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39f6b94d-d05c-4309-8b06-e27ba3215b09',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.684059] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-fdb8c1f0-2434-4bb9-8de4-4b4f8d630d5a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.684213] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fdb8c1f0-2434-4bb9-8de4-4b4f8d630d5a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.684285] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fdb8c1f0-2434-4bb9-8de4-4b4f8d630d5a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.684498] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fdb8c1f0-2434-4bb9-8de4-4b4f8d630d5a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.684579] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fdb8c1f0-2434-4bb9-8de4-4b4f8d630d5a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.688788] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.688788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.688788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.688788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.688788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.702496] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 in Status: IN_PROGRESS for 2s [ 735.188171] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39f6b94d-d05c-4309-8b06-e27ba3215b09',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.194772] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-39f6b94d-d05c-4309-8b06-e27ba3215b09 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.194772] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39f6b94d-d05c-4309-8b06-e27ba3215b09" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.194772] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fdb8c1f0-2434-4bb9-8de4-4b4f8d630d5a with status ACTIVE [ 735.194772] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.194772] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.194772] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.194772] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.194772] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.194772] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.194772] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.194772] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.194772] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.194772] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.194772] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.195232] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.195232] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.195232] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.195232] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.195232] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fdb8c1f0-2434-4bb9-8de4-4b4f8d630d5a is going to be updated. [ 735.220998] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.220998] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.220998] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.220998] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.220998] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.220998] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fdb8c1f0-2434-4bb9-8de4-4b4f8d630d5a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.696907] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39f6b94d-d05c-4309-8b06-e27ba3215b09',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.198319] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.198469] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.198653] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.198751] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.198842] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.198942] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39f6b94d-d05c-4309-8b06-e27ba3215b09 is going to be created. [ 736.259527] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.259750] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.259811] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.260014] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.260199] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.276588] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39f6b94d-d05c-4309-8b06-e27ba3215b09 in Status: UNINITIALIZED for 2s [ 736.716190] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 in Status: SUCCESS [ 736.716476] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.908272] env[69506]: INFO networking_nsxv3.common.synchronization [req-375240e0-d7dd-4ae5-965e-a120d6b9cf4c req-b234cc45-e925-4b29-b732-ab71d8377417 tempest-ServerDiagnosticsTest-1919427399 tempest-ServerDiagnosticsTest-1919427399-project-member] Enqueued Resource ID: 7d665e3e-5768-414e-b88d-89e23ff633e1 with Priority: HIGHEST for action security_group_members [ 736.909084] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d665e3e-5768-414e-b88d-89e23ff633e1 with Priority: HIGHEST for action security_group_members [ 736.909254] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d665e3e-5768-414e-b88d-89e23ff633e1 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.909379] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d665e3e-5768-414e-b88d-89e23ff633e1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.909449] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d665e3e-5768-414e-b88d-89e23ff633e1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.909670] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d665e3e-5768-414e-b88d-89e23ff633e1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.909840] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.909940] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.910010] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.910168] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.910281] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.910385] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d665e3e-5768-414e-b88d-89e23ff633e1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.414157] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.414157] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.414157] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.414157] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.414370] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.414821] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.414821] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.414821] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.414945] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.415046] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.415723] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d665e3e-5768-414e-b88d-89e23ff633e1 is going to be updated. [ 737.445673] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.445900] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.445980] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.446219] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.446374] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.455603] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d665e3e-5768-414e-b88d-89e23ff633e1 in Status: IN_PROGRESS for 2s [ 737.643359] env[69506]: INFO networking_nsxv3.common.synchronization [req-1f0c4821-49cd-4cfb-a9b1-a309ce70a1b0 req-90413889-c920-4070-9c87-7291ff73d530 tempest-InstanceActionsNegativeTestJSON-1732575951 tempest-InstanceActionsNegativeTestJSON-1732575951-project-member] Enqueued Resource ID: 386ab661-7bf3-4005-884c-cf906d5c497b with Priority: HIGHEST for action security_group_members [ 737.644483] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 386ab661-7bf3-4005-884c-cf906d5c497b with Priority: HIGHEST for action security_group_members [ 737.644483] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-386ab661-7bf3-4005-884c-cf906d5c497b taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.644483] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-386ab661-7bf3-4005-884c-cf906d5c497b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.644483] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-386ab661-7bf3-4005-884c-cf906d5c497b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.644815] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-386ab661-7bf3-4005-884c-cf906d5c497b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.645209] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.645979] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.645979] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.645979] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.645979] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.645979] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('386ab661-7bf3-4005-884c-cf906d5c497b',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.149166] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.149463] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.149520] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.149741] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.149831] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.150040] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.150142] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.150205] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.150408] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.150461] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.150530] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 386ab661-7bf3-4005-884c-cf906d5c497b is going to be updated. [ 738.219047] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.219047] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.219278] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.219978] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.219978] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.228603] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 386ab661-7bf3-4005-884c-cf906d5c497b in Status: IN_PROGRESS for 2s [ 738.296941] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39f6b94d-d05c-4309-8b06-e27ba3215b09 in Status: SUCCESS [ 738.296941] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39f6b94d-d05c-4309-8b06-e27ba3215b09" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.296941] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39f6b94d-d05c-4309-8b06-e27ba3215b09" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.296941] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39f6b94d-d05c-4309-8b06-e27ba3215b09" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.296941] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.296941] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.296941] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.296941] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.296941] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.296941] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39f6b94d-d05c-4309-8b06-e27ba3215b09" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.296941] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('39f6b94d-d05c-4309-8b06-e27ba3215b09',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.799460] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-39f6b94d-d05c-4309-8b06-e27ba3215b09 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.799882] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39f6b94d-d05c-4309-8b06-e27ba3215b09" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.799882] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39f6b94d-d05c-4309-8b06-e27ba3215b09" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.799882] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39f6b94d-d05c-4309-8b06-e27ba3215b09" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.801229] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.801229] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.801229] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.801229] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.801429] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.801429] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39f6b94d-d05c-4309-8b06-e27ba3215b09" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.803272] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-39f6b94d-d05c-4309-8b06-e27ba3215b09 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.803272] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39f6b94d-d05c-4309-8b06-e27ba3215b09" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.803272] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39f6b94d-d05c-4309-8b06-e27ba3215b09" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.803272] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39f6b94d-d05c-4309-8b06-e27ba3215b09" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.803272] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.803272] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.803272] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.803272] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.803272] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.803272] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39f6b94d-d05c-4309-8b06-e27ba3215b09" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.803272] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('39f6b94d-d05c-4309-8b06-e27ba3215b09',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.306017] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 39f6b94d-d05c-4309-8b06-e27ba3215b09: rpc.has_security_group_logging(os_id): False [ 739.324254] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.324549] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.324644] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.324865] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.324958] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.325191] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.325292] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.325354] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.325504] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.325581] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.325784] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.325877] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.325941] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.326116] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.326226] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.326400] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.326491] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.326551] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.326701] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.326776] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.326878] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39f6b94d-d05c-4309-8b06-e27ba3215b09 is going to be created. [ 739.393980] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.394192] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.394266] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.394475] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.394644] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.406803] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39f6b94d-d05c-4309-8b06-e27ba3215b09 in Status: IN_PROGRESS for 2s [ 739.465288] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d665e3e-5768-414e-b88d-89e23ff633e1 in Status: SUCCESS [ 739.465524] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d665e3e-5768-414e-b88d-89e23ff633e1 deletion is rescheduled due to dependency. [ 739.465674] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d665e3e-5768-414e-b88d-89e23ff633e1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.689011] env[69506]: INFO networking_nsxv3.common.synchronization [req-6ac32688-a8d3-41d9-86f6-6872a8d14ed9 req-cc9abfa6-008a-4bd5-a715-0d3a88a536a1 tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_members [ 739.689591] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_members [ 739.689882] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a27cb9c-bb13-44cb-a531-49610a94a36e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.689994] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.690580] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.690955] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.692074] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.692074] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.692074] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.692074] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.692254] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.692254] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.137935] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-828 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.138851] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-828" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.139035] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-828" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.139359] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-828" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.139866] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.140122] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.143590] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.143935] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.144288] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.144460] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 740.144460] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 740.144574] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 740.144673] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 740.144787] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 740.144894] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 740.145039] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 740.165692] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 740.165925] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 740.166224] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 740.166427] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-828" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.166879] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-83b3fa78-db84-4486-94a7-0dc721bd750d taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.167114] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-83b3fa78-db84-4486-94a7-0dc721bd750d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.167240] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-83b3fa78-db84-4486-94a7-0dc721bd750d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.170616] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-83b3fa78-db84-4486-94a7-0dc721bd750d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.170785] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83b3fa78-db84-4486-94a7-0dc721bd750d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.194937] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.194937] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.194937] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.194937] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.194937] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.195175] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.195175] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.195265] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.195344] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.195431] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.195518] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e already deleted. [ 740.195617] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.238237] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 386ab661-7bf3-4005-884c-cf906d5c497b in Status: SUCCESS [ 740.238313] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 386ab661-7bf3-4005-884c-cf906d5c497b deletion is rescheduled due to dependency. [ 740.239242] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-386ab661-7bf3-4005-884c-cf906d5c497b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.249966] env[69506]: INFO networking_nsxv3.common.synchronization [req-e7ce10f5-dcb8-47e4-baee-08d779e030b8 req-759d002a-511c-4754-a99b-f009f2136015 tempest-ImagesTestJSON-821230832 tempest-ImagesTestJSON-821230832-project-member] Enqueued Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_members [ 740.250867] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_members [ 740.250867] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0db323-2ed4-4f6a-a30a-405b16133cb2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.251062] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.251062] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.251231] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.251382] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.251509] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.251565] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.251696] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.251781] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.251874] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.673886] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.674230] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.674269] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.674622] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.675065] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.675065] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 83b3fa78-db84-4486-94a7-0dc721bd750d not found, creating... [ 740.675318] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.675483] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.675603] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.675834] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.675975] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.676279] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.676421] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.676540] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.676749] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.676883] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.677151] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 83b3fa78-db84-4486-94a7-0dc721bd750d is going to be created. [ 740.702894] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.703135] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.703244] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.703521] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.703749] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.703972] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-83b3fa78-db84-4486-94a7-0dc721bd750d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.754486] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.754486] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.754486] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.754486] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.754624] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.754864] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.754864] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.755026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.755077] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.755133] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.755226] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 is going to be updated. [ 740.811238] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.811422] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.811489] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.811647] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.811786] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.821112] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: IN_PROGRESS for 2s [ 740.979132] env[69506]: INFO networking_nsxv3.common.synchronization [None req-1b141a9f-23eb-4534-b752-8455b716d8c6 None None] Enqueued Resource ID: 4a7528c7-2586-405d-89be-a848a3f583d6 with Priority: HIGHEST for action port [ 740.979132] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a7528c7-2586-405d-89be-a848a3f583d6 with Priority: HIGHEST for action port [ 740.979132] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a7528c7-2586-405d-89be-a848a3f583d6 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.979132] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a7528c7-2586-405d-89be-a848a3f583d6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.979132] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a7528c7-2586-405d-89be-a848a3f583d6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.979132] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a7528c7-2586-405d-89be-a848a3f583d6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.979132] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a7528c7-2586-405d-89be-a848a3f583d6',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.419144] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39f6b94d-d05c-4309-8b06-e27ba3215b09 in Status: SUCCESS [ 741.420689] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39f6b94d-d05c-4309-8b06-e27ba3215b09" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.481750] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4a7528c7-2586-405d-89be-a848a3f583d6 [ 741.481750] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.481750] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.481750] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.482455] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.482455] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.482455] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4a7528c7-2586-405d-89be-a848a3f583d6 already deleted. [ 741.482455] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a7528c7-2586-405d-89be-a848a3f583d6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.628553] env[69506]: INFO networking_nsxv3.common.synchronization [req-6ac32688-a8d3-41d9-86f6-6872a8d14ed9 req-2167b753-e993-4ab3-8d5a-36e9e9ee91d7 service nova] Enqueued Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_rules [ 741.628749] env[69506]: INFO networking_nsxv3.common.synchronization [req-6ac32688-a8d3-41d9-86f6-6872a8d14ed9 req-2167b753-e993-4ab3-8d5a-36e9e9ee91d7 service nova] Enqueued Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_members [ 741.628908] env[69506]: INFO networking_nsxv3.common.synchronization [req-6ac32688-a8d3-41d9-86f6-6872a8d14ed9 req-2167b753-e993-4ab3-8d5a-36e9e9ee91d7 service nova] Enqueued Resource ID: 83b3fa78-db84-4486-94a7-0dc721bd750d with Priority: HIGHEST for action port [ 741.629434] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_rules [ 741.629567] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_members [ 741.629662] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83b3fa78-db84-4486-94a7-0dc721bd750d with Priority: HIGHEST for action port [ 741.629933] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a27cb9c-bb13-44cb-a531-49610a94a36e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.630334] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.630430] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.630827] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.630916] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.633288] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a27cb9c-bb13-44cb-a531-49610a94a36e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.633449] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.633523] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.633697] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.633848] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.634160] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.634246] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.634556] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.634649] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.634755] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.635499] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-83b3fa78-db84-4486-94a7-0dc721bd750d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.635606] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83b3fa78-db84-4486-94a7-0dc721bd750d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.635673] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83b3fa78-db84-4486-94a7-0dc721bd750d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.635819] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83b3fa78-db84-4486-94a7-0dc721bd750d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.635913] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83b3fa78-db84-4486-94a7-0dc721bd750d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.137845] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a27cb9c-bb13-44cb-a531-49610a94a36e taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.138198] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.138244] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.141515] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 83b3fa78-db84-4486-94a7-0dc721bd750d with status ACTIVE [ 742.141768] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.141952] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.142152] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.142485] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.142571] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.142948] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.143088] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.143155] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.143323] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.143405] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.143745] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.143927] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.144072] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.144324] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.144485] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.144655] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 83b3fa78-db84-4486-94a7-0dc721bd750d is going to be updated. [ 742.184580] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.185664] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.185664] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.185664] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.185664] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.185664] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83b3fa78-db84-4486-94a7-0dc721bd750d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.508688] env[69506]: INFO networking_nsxv3.common.synchronization [None req-d5f4078d-cba0-48a0-a64b-f3849cc387ab tempest-MigrationsAdminTest-625008670 tempest-MigrationsAdminTest-625008670-project-member] Enqueued Resource ID: 678bf3b3-516a-4e0b-ba66-621ba0e242b4 with Priority: HIGHEST for action security_group_rules [ 742.509617] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 678bf3b3-516a-4e0b-ba66-621ba0e242b4 with Priority: HIGHEST for action security_group_rules [ 742.509958] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-678bf3b3-516a-4e0b-ba66-621ba0e242b4 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.510068] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-678bf3b3-516a-4e0b-ba66-621ba0e242b4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.510157] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-678bf3b3-516a-4e0b-ba66-621ba0e242b4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.510436] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-678bf3b3-516a-4e0b-ba66-621ba0e242b4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.510520] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('678bf3b3-516a-4e0b-ba66-621ba0e242b4',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.647975] env[69506]: INFO networking_nsxv3.common.synchronization [None req-67e77ca9-a6b6-4abb-ad4b-0392dd9559dc tempest-MigrationsAdminTest-625008670 tempest-MigrationsAdminTest-625008670-project-member] Enqueued Resource ID: 678bf3b3-516a-4e0b-ba66-621ba0e242b4 with Priority: HIGHEST for action security_group_rules [ 742.647975] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.650450] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 678bf3b3-516a-4e0b-ba66-621ba0e242b4 with Priority: HIGHEST for action security_group_rules [ 742.650450] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-678bf3b3-516a-4e0b-ba66-621ba0e242b4 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.650450] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-678bf3b3-516a-4e0b-ba66-621ba0e242b4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.837372] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: SUCCESS [ 742.837372] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 deletion is rescheduled due to dependency. [ 742.837372] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.034018] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.034229] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.034229] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.034545] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.034607] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.034680] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 678bf3b3-516a-4e0b-ba66-621ba0e242b4 already deleted. [ 743.034861] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-678bf3b3-516a-4e0b-ba66-621ba0e242b4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.034921] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-678bf3b3-516a-4e0b-ba66-621ba0e242b4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.035095] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-678bf3b3-516a-4e0b-ba66-621ba0e242b4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.035182] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('678bf3b3-516a-4e0b-ba66-621ba0e242b4',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.151083] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.151442] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.151442] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.151581] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.151712] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.151816] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e is going to be created. [ 743.176083] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.176277] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.176352] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.176570] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.176727] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.197401] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e in Status: UNINITIALIZED for 2s [ 743.556994] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.557518] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.557518] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.558829] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.558829] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.558829] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 678bf3b3-516a-4e0b-ba66-621ba0e242b4 already deleted. [ 743.558829] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-678bf3b3-516a-4e0b-ba66-621ba0e242b4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.629570] env[69506]: INFO networking_nsxv3.common.synchronization [None req-3580acf8-fda3-4962-a0f6-f8e17e5ac11a None None] Enqueued Resource ID: 24eeeccc-7d00-49b8-ab1c-27dec2cd4035 with Priority: HIGHEST for action port [ 743.631684] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24eeeccc-7d00-49b8-ab1c-27dec2cd4035 with Priority: HIGHEST for action port [ 743.631684] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-24eeeccc-7d00-49b8-ab1c-27dec2cd4035 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.631684] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24eeeccc-7d00-49b8-ab1c-27dec2cd4035" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.631684] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24eeeccc-7d00-49b8-ab1c-27dec2cd4035" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.631684] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24eeeccc-7d00-49b8-ab1c-27dec2cd4035" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.631684] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24eeeccc-7d00-49b8-ab1c-27dec2cd4035',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.901268] env[69506]: INFO networking_nsxv3.common.synchronization [req-8df61115-3a73-4e03-a4aa-ee1e2397803d req-278aa04c-dacc-4d6b-972b-7b33ce25024f tempest-ServerDiskConfigTestJSON-583020681 tempest-ServerDiskConfigTestJSON-583020681-project-member] Enqueued Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_members [ 743.901998] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_members [ 743.901998] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-008501d4-938b-4336-9c1d-ef3665f7d09d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.902176] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.902176] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.902368] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.902536] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.902740] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.902740] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.902870] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.902955] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.903062] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.134875] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 24eeeccc-7d00-49b8-ab1c-27dec2cd4035 [ 744.134875] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.134875] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.134875] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.134875] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.134875] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.134875] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:24eeeccc-7d00-49b8-ab1c-27dec2cd4035 already deleted. [ 744.134875] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24eeeccc-7d00-49b8-ab1c-27dec2cd4035" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.406083] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.406083] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.406083] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.406083] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.406083] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.406774] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.406774] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.407787] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.407787] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.407787] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.407787] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 008501d4-938b-4336-9c1d-ef3665f7d09d is going to be updated. [ 744.440456] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.440456] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.440456] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.440637] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.440798] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.450569] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 008501d4-938b-4336-9c1d-ef3665f7d09d in Status: IN_PROGRESS for 2s [ 745.207261] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e in Status: SUCCESS [ 745.207477] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.207642] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.207854] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.208055] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.208246] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.208309] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.208465] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.208547] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.208633] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.208722] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.579254] env[69506]: INFO networking_nsxv3.common.synchronization [req-0b0e7895-165d-463c-bc24-43cbbe5aa5fd req-e586ec10-c167-460c-bfe4-7cd255d31afd tempest-ServerAddressesTestJSON-1737983309 tempest-ServerAddressesTestJSON-1737983309-project-member] Enqueued Resource ID: 39f6b94d-d05c-4309-8b06-e27ba3215b09 with Priority: HIGHEST for action security_group_members [ 745.580527] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39f6b94d-d05c-4309-8b06-e27ba3215b09 with Priority: HIGHEST for action security_group_members [ 745.580851] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-39f6b94d-d05c-4309-8b06-e27ba3215b09 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.580986] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39f6b94d-d05c-4309-8b06-e27ba3215b09" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.581068] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39f6b94d-d05c-4309-8b06-e27ba3215b09" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.581308] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39f6b94d-d05c-4309-8b06-e27ba3215b09" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.581473] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.581583] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.581658] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.581820] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.581918] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.582038] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39f6b94d-d05c-4309-8b06-e27ba3215b09',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.711879] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a27cb9c-bb13-44cb-a531-49610a94a36e taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.712074] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.712141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.712344] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.712506] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.712600] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.712670] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.713233] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.713233] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.713233] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.713233] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a27cb9c-bb13-44cb-a531-49610a94a36e taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.713233] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.713466] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.713466] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.713523] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.713598] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.713655] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.713785] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.713855] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.713932] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.714031] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.084176] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.084389] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.084389] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.084644] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.084743] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.084938] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.085038] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.085101] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.085256] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.085332] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.085420] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39f6b94d-d05c-4309-8b06-e27ba3215b09 is going to be updated. [ 746.116349] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.116491] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.116569] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.117118] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.117118] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.125929] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39f6b94d-d05c-4309-8b06-e27ba3215b09 in Status: IN_PROGRESS for 2s [ 746.216557] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a27cb9c-bb13-44cb-a531-49610a94a36e: rpc.has_security_group_logging(os_id): False [ 746.244206] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.244353] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.244419] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.244630] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.244725] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.244922] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.245041] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.245109] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.245262] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.245337] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.245537] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.245671] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.245708] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.245819] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.245898] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.246169] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.246267] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.246329] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.246469] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.246540] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.246627] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e is going to be created. [ 746.313833] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.314046] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.314132] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.314292] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.314473] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.340689] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e in Status: IN_PROGRESS for 2s [ 746.459492] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 008501d4-938b-4336-9c1d-ef3665f7d09d in Status: SUCCESS [ 746.459662] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 008501d4-938b-4336-9c1d-ef3665f7d09d deletion is rescheduled due to dependency. [ 746.459776] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.923357] env[69506]: INFO networking_nsxv3.common.synchronization [req-a8fba3fb-3145-4e1f-a3dd-4025127ffcc0 req-65eec5fc-82d4-4756-84c2-f63798a720c1 tempest-ListServerFiltersTestJSON-2708404 tempest-ListServerFiltersTestJSON-2708404-project-member] Enqueued Resource ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d with Priority: HIGHEST for action security_group_members [ 746.923357] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d with Priority: HIGHEST for action security_group_members [ 746.923667] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-823c6679-501c-4ec2-9d9f-f49b7cc1205d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.923752] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.923795] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.923987] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.924151] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.924805] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.924889] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.925159] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.925266] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.925380] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('823c6679-501c-4ec2-9d9f-f49b7cc1205d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.142017] env[69506]: INFO networking_nsxv3.common.synchronization [req-795a132d-4faf-46c2-a1a0-d742ee85349b req-1b1576e2-ca6d-4047-a294-9c14f73f843f tempest-ServersAdminNegativeTestJSON-1868968513 tempest-ServersAdminNegativeTestJSON-1868968513-project-member] Enqueued Resource ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 with Priority: HIGHEST for action security_group_members [ 747.142017] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 with Priority: HIGHEST for action security_group_members [ 747.142017] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-78caaaf6-868f-4043-93dd-d9a75a05d023 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.142017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.145194] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.145194] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.145194] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.145194] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.145194] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.145194] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.145194] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.145194] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78caaaf6-868f-4043-93dd-d9a75a05d023',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.427432] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('823c6679-501c-4ec2-9d9f-f49b7cc1205d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.471567] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-438 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.471779] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.471945] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.472232] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.472496] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.472660] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.472774] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.473040] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.473201] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.473409] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 747.473521] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 747.473630] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 747.473736] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 747.473841] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 747.473943] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 747.474083] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 747.492300] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 747.492300] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 747.492406] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 747.492549] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.492821] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-5475859b-1569-4c40-b23d-2d51a2f799e3 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.492980] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-5475859b-1569-4c40-b23d-2d51a2f799e3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.493111] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-5475859b-1569-4c40-b23d-2d51a2f799e3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.493388] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-5475859b-1569-4c40-b23d-2d51a2f799e3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.493525] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5475859b-1569-4c40-b23d-2d51a2f799e3',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.647064] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.647064] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.647064] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.647256] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.647339] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.647689] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.647806] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.647876] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.648147] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.648305] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.648404] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 already deleted. [ 747.648491] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.930161] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('823c6679-501c-4ec2-9d9f-f49b7cc1205d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.123406] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.123406] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.123406] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.123667] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.123667] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.124921] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 5475859b-1569-4c40-b23d-2d51a2f799e3 not found, creating... [ 748.124921] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.124921] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.124921] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.124921] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.124921] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.125247] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.125322] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.125507] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.125751] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.125886] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.126031] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 5475859b-1569-4c40-b23d-2d51a2f799e3 is going to be created. [ 748.135450] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39f6b94d-d05c-4309-8b06-e27ba3215b09 in Status: SUCCESS [ 748.135614] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39f6b94d-d05c-4309-8b06-e27ba3215b09 deletion is rescheduled due to dependency. [ 748.135715] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39f6b94d-d05c-4309-8b06-e27ba3215b09" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.146162] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.146339] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.146460] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.146685] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.146899] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.147109] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-5475859b-1569-4c40-b23d-2d51a2f799e3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.355069] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e in Status: SUCCESS [ 748.355326] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.434097] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.434257] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.434472] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.434538] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.434629] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.434728] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d is going to be updated. [ 748.473279] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.473446] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.473518] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.473734] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.473874] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.482299] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d in Status: IN_PROGRESS for 2s [ 748.710008] env[69506]: INFO networking_nsxv3.common.synchronization [req-795a132d-4faf-46c2-a1a0-d742ee85349b req-28be4fad-4bb4-491d-a0ed-400b5efec3de service nova] Enqueued Resource ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 with Priority: HIGHEST for action security_group_rules [ 748.710235] env[69506]: INFO networking_nsxv3.common.synchronization [req-795a132d-4faf-46c2-a1a0-d742ee85349b req-28be4fad-4bb4-491d-a0ed-400b5efec3de service nova] Enqueued Resource ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 with Priority: HIGHEST for action security_group_members [ 748.710368] env[69506]: INFO networking_nsxv3.common.synchronization [req-795a132d-4faf-46c2-a1a0-d742ee85349b req-28be4fad-4bb4-491d-a0ed-400b5efec3de service nova] Enqueued Resource ID: 5475859b-1569-4c40-b23d-2d51a2f799e3 with Priority: HIGHEST for action port [ 748.710625] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 with Priority: HIGHEST for action security_group_rules [ 748.710749] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 with Priority: HIGHEST for action security_group_members [ 748.710844] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5475859b-1569-4c40-b23d-2d51a2f799e3 with Priority: HIGHEST for action port [ 748.711734] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78caaaf6-868f-4043-93dd-d9a75a05d023 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.711860] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.711929] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.712788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.712878] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78caaaf6-868f-4043-93dd-d9a75a05d023',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.714118] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-78caaaf6-868f-4043-93dd-d9a75a05d023 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.714236] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.714308] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.714829] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.714987] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.715095] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.715180] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.715337] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.715425] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.715510] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78caaaf6-868f-4043-93dd-d9a75a05d023',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.717752] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-5475859b-1569-4c40-b23d-2d51a2f799e3 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.717752] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5475859b-1569-4c40-b23d-2d51a2f799e3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.717752] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5475859b-1569-4c40-b23d-2d51a2f799e3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.717752] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5475859b-1569-4c40-b23d-2d51a2f799e3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.717752] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5475859b-1569-4c40-b23d-2d51a2f799e3',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.214667] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-78caaaf6-868f-4043-93dd-d9a75a05d023 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.215094] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.217341] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78caaaf6-868f-4043-93dd-d9a75a05d023',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.218320] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5475859b-1569-4c40-b23d-2d51a2f799e3 with status ACTIVE [ 749.218514] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.218627] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.218690] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.218896] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.218987] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.219175] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.219275] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.219330] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.219472] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.219545] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.219723] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.219856] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.219956] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.220127] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.220205] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.220293] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5475859b-1569-4c40-b23d-2d51a2f799e3 is going to be updated. [ 749.245530] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.245768] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.245768] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.245876] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.246026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.246202] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5475859b-1569-4c40-b23d-2d51a2f799e3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.371223] env[69506]: INFO networking_nsxv3.common.synchronization [req-5ce0fb7a-9be8-4547-bd39-a3accbde11f2 req-74b28e88-87e4-438c-a730-5639c27161d3 tempest-ServersNegativeTestMultiTenantJSON-1179789130 tempest-ServersNegativeTestMultiTenantJSON-1179789130-project-member] Enqueued Resource ID: 9ba7662d-ea93-4828-a093-1d0b8a8fc40f with Priority: HIGHEST for action security_group_members [ 749.371717] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ba7662d-ea93-4828-a093-1d0b8a8fc40f with Priority: HIGHEST for action security_group_members [ 749.372023] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ba7662d-ea93-4828-a093-1d0b8a8fc40f taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.372145] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ba7662d-ea93-4828-a093-1d0b8a8fc40f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.372213] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ba7662d-ea93-4828-a093-1d0b8a8fc40f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.372460] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ba7662d-ea93-4828-a093-1d0b8a8fc40f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.372610] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.373014] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.373014] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.373014] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.373014] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.373195] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ba7662d-ea93-4828-a093-1d0b8a8fc40f',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.727191] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78caaaf6-868f-4043-93dd-d9a75a05d023',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.761300] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-689 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.761921] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-689" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.762118] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-689" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.762660] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-689" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.763111] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.763384] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.763896] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.768065] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.768065] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.768065] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 749.768065] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 749.768065] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 749.768065] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 749.768065] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 749.768512] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 749.768626] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 749.791812] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 749.791812] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 749.791812] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 749.792091] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-689" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.792320] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-1e384e5c-098b-4320-90bc-93c3d27366b1 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.792524] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-1e384e5c-098b-4320-90bc-93c3d27366b1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.793377] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-1e384e5c-098b-4320-90bc-93c3d27366b1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.793377] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-1e384e5c-098b-4320-90bc-93c3d27366b1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.793377] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e384e5c-098b-4320-90bc-93c3d27366b1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.875199] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.875362] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.875430] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.875654] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.875749] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.875940] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.876068] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.876147] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.876301] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.876380] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.876469] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ba7662d-ea93-4828-a093-1d0b8a8fc40f already deleted. [ 749.876617] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ba7662d-ea93-4828-a093-1d0b8a8fc40f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.231442] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.231442] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.231442] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.231442] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.231442] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.231442] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 is going to be created. [ 750.262553] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.262695] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.262695] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.262853] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.263037] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.271297] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 in Status: UNINITIALIZED for 2s [ 750.296380] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.296612] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.296737] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.297017] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.297174] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.297333] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 1e384e5c-098b-4320-90bc-93c3d27366b1 not found, creating... [ 750.297662] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.297831] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.297951] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.298205] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.298365] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.298653] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.298810] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.298927] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.299169] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.299316] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.299458] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 1e384e5c-098b-4320-90bc-93c3d27366b1 is going to be created. [ 750.320086] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.320286] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.320409] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.320661] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.320878] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.321098] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-1e384e5c-098b-4320-90bc-93c3d27366b1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.491202] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d in Status: SUCCESS [ 750.491462] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.994054] env[69506]: INFO networking_nsxv3.common.synchronization [req-5c80b1da-e16b-43c5-863a-1a098bc8ce49 req-704eaa1e-ce08-4c9d-a2df-a7d300f4e657 tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: 64557eb9-9b83-42ab-99e4-278f5711a22e with Priority: HIGHEST for action security_group_members [ 750.994319] env[69506]: INFO networking_nsxv3.common.synchronization [req-5c80b1da-e16b-43c5-863a-1a098bc8ce49 req-704eaa1e-ce08-4c9d-a2df-a7d300f4e657 tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_members [ 750.994728] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64557eb9-9b83-42ab-99e4-278f5711a22e with Priority: HIGHEST for action security_group_members [ 750.995321] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_members [ 750.995529] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-64557eb9-9b83-42ab-99e4-278f5711a22e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.995700] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.995790] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.997196] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.997196] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.997196] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.997196] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.997196] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.997196] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.997487] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64557eb9-9b83-42ab-99e4-278f5711a22e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.998108] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a27cb9c-bb13-44cb-a531-49610a94a36e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.998338] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.998432] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.998624] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.998786] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.998893] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.998957] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.999229] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.999302] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.999396] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.048858] env[69506]: INFO networking_nsxv3.common.synchronization [req-5c80b1da-e16b-43c5-863a-1a098bc8ce49 req-704eaa1e-ce08-4c9d-a2df-a7d300f4e657 tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_rules [ 751.051166] env[69506]: INFO networking_nsxv3.common.synchronization [req-5c80b1da-e16b-43c5-863a-1a098bc8ce49 req-704eaa1e-ce08-4c9d-a2df-a7d300f4e657 tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_members [ 751.051166] env[69506]: INFO networking_nsxv3.common.synchronization [req-5c80b1da-e16b-43c5-863a-1a098bc8ce49 req-704eaa1e-ce08-4c9d-a2df-a7d300f4e657 tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: 64557eb9-9b83-42ab-99e4-278f5711a22e with Priority: HIGHEST for action security_group_rules [ 751.051166] env[69506]: INFO networking_nsxv3.common.synchronization [req-5c80b1da-e16b-43c5-863a-1a098bc8ce49 req-704eaa1e-ce08-4c9d-a2df-a7d300f4e657 tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: 64557eb9-9b83-42ab-99e4-278f5711a22e with Priority: HIGHEST for action security_group_members [ 751.051166] env[69506]: INFO networking_nsxv3.common.synchronization [req-5c80b1da-e16b-43c5-863a-1a098bc8ce49 req-704eaa1e-ce08-4c9d-a2df-a7d300f4e657 tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: 83b3fa78-db84-4486-94a7-0dc721bd750d with Priority: HIGHEST for action port [ 751.051166] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_rules [ 751.051166] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64557eb9-9b83-42ab-99e4-278f5711a22e with Priority: HIGHEST for action security_group_rules [ 751.051166] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83b3fa78-db84-4486-94a7-0dc721bd750d with Priority: HIGHEST for action port [ 751.051166] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_members [ 751.051166] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64557eb9-9b83-42ab-99e4-278f5711a22e with Priority: HIGHEST for action security_group_members [ 751.051476] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a27cb9c-bb13-44cb-a531-49610a94a36e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.051476] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.051476] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.051636] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.051879] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.057024] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64557eb9-9b83-42ab-99e4-278f5711a22e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.057024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.057024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.057024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.057024] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64557eb9-9b83-42ab-99e4-278f5711a22e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.057024] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-83b3fa78-db84-4486-94a7-0dc721bd750d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.057024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83b3fa78-db84-4486-94a7-0dc721bd750d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.057024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83b3fa78-db84-4486-94a7-0dc721bd750d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.057024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83b3fa78-db84-4486-94a7-0dc721bd750d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.057024] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83b3fa78-db84-4486-94a7-0dc721bd750d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.057024] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a27cb9c-bb13-44cb-a531-49610a94a36e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.057024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.057024] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-64557eb9-9b83-42ab-99e4-278f5711a22e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.057024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.164358] env[69506]: INFO networking_nsxv3.common.synchronization [req-5ce0fb7a-9be8-4547-bd39-a3accbde11f2 req-94d8da94-f79e-4e2c-9fd3-d4ffbfd5870e service nova] Enqueued Resource ID: 9ba7662d-ea93-4828-a093-1d0b8a8fc40f with Priority: HIGHEST for action security_group_rules [ 751.164543] env[69506]: INFO networking_nsxv3.common.synchronization [req-5ce0fb7a-9be8-4547-bd39-a3accbde11f2 req-94d8da94-f79e-4e2c-9fd3-d4ffbfd5870e service nova] Enqueued Resource ID: 9ba7662d-ea93-4828-a093-1d0b8a8fc40f with Priority: HIGHEST for action security_group_members [ 751.164684] env[69506]: INFO networking_nsxv3.common.synchronization [req-5ce0fb7a-9be8-4547-bd39-a3accbde11f2 req-94d8da94-f79e-4e2c-9fd3-d4ffbfd5870e service nova] Enqueued Resource ID: 1e384e5c-098b-4320-90bc-93c3d27366b1 with Priority: HIGHEST for action port [ 751.165088] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ba7662d-ea93-4828-a093-1d0b8a8fc40f with Priority: HIGHEST for action security_group_rules [ 751.165088] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ba7662d-ea93-4828-a093-1d0b8a8fc40f with Priority: HIGHEST for action security_group_members [ 751.165167] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e384e5c-098b-4320-90bc-93c3d27366b1 with Priority: HIGHEST for action port [ 751.165896] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ba7662d-ea93-4828-a093-1d0b8a8fc40f taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.167606] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ba7662d-ea93-4828-a093-1d0b8a8fc40f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.167606] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ba7662d-ea93-4828-a093-1d0b8a8fc40f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.167606] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ba7662d-ea93-4828-a093-1d0b8a8fc40f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.167606] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ba7662d-ea93-4828-a093-1d0b8a8fc40f',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.168532] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ba7662d-ea93-4828-a093-1d0b8a8fc40f taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.172019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ba7662d-ea93-4828-a093-1d0b8a8fc40f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.172019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ba7662d-ea93-4828-a093-1d0b8a8fc40f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.172019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ba7662d-ea93-4828-a093-1d0b8a8fc40f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.172019] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.172019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.172019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.172019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.172019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.172019] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ba7662d-ea93-4828-a093-1d0b8a8fc40f',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.172019] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e384e5c-098b-4320-90bc-93c3d27366b1 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.172019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e384e5c-098b-4320-90bc-93c3d27366b1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.172019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e384e5c-098b-4320-90bc-93c3d27366b1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.172019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e384e5c-098b-4320-90bc-93c3d27366b1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.172019] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e384e5c-098b-4320-90bc-93c3d27366b1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.388049] env[69506]: INFO networking_nsxv3.common.synchronization [req-e2f9ecaa-c0f6-4f23-886f-c63a1902a2cb req-6d4320f6-0fd3-4ba6-80c1-3e3c7803eceb tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: 64557eb9-9b83-42ab-99e4-278f5711a22e with Priority: HIGHEST for action security_group_members [ 751.388339] env[69506]: INFO networking_nsxv3.common.synchronization [req-e2f9ecaa-c0f6-4f23-886f-c63a1902a2cb req-6d4320f6-0fd3-4ba6-80c1-3e3c7803eceb tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_members [ 751.388433] env[69506]: INFO networking_nsxv3.common.synchronization [req-e2f9ecaa-c0f6-4f23-886f-c63a1902a2cb req-6d4320f6-0fd3-4ba6-80c1-3e3c7803eceb tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: 753050ac-8ed4-4825-8136-44279adacb0f with Priority: HIGHEST for action security_group_members [ 751.388948] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64557eb9-9b83-42ab-99e4-278f5711a22e with Priority: HIGHEST for action security_group_members [ 751.389188] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_members [ 751.389318] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 753050ac-8ed4-4825-8136-44279adacb0f with Priority: HIGHEST for action security_group_members [ 751.389595] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-64557eb9-9b83-42ab-99e4-278f5711a22e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.389696] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.389880] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a27cb9c-bb13-44cb-a531-49610a94a36e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.389961] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.390145] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-753050ac-8ed4-4825-8136-44279adacb0f taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.390245] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-753050ac-8ed4-4825-8136-44279adacb0f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.390306] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-753050ac-8ed4-4825-8136-44279adacb0f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.390625] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-753050ac-8ed4-4825-8136-44279adacb0f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.390775] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.390885] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.390927] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.391331] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.391331] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.391331] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('753050ac-8ed4-4825-8136-44279adacb0f',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.432268] env[69506]: INFO networking_nsxv3.common.synchronization [req-e2f9ecaa-c0f6-4f23-886f-c63a1902a2cb req-6d4320f6-0fd3-4ba6-80c1-3e3c7803eceb tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_rules [ 751.432553] env[69506]: INFO networking_nsxv3.common.synchronization [req-e2f9ecaa-c0f6-4f23-886f-c63a1902a2cb req-6d4320f6-0fd3-4ba6-80c1-3e3c7803eceb tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_members [ 751.432785] env[69506]: INFO networking_nsxv3.common.synchronization [req-e2f9ecaa-c0f6-4f23-886f-c63a1902a2cb req-6d4320f6-0fd3-4ba6-80c1-3e3c7803eceb tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: 64557eb9-9b83-42ab-99e4-278f5711a22e with Priority: HIGHEST for action security_group_rules [ 751.433089] env[69506]: INFO networking_nsxv3.common.synchronization [req-e2f9ecaa-c0f6-4f23-886f-c63a1902a2cb req-6d4320f6-0fd3-4ba6-80c1-3e3c7803eceb tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: 64557eb9-9b83-42ab-99e4-278f5711a22e with Priority: HIGHEST for action security_group_members [ 751.433243] env[69506]: INFO networking_nsxv3.common.synchronization [req-e2f9ecaa-c0f6-4f23-886f-c63a1902a2cb req-6d4320f6-0fd3-4ba6-80c1-3e3c7803eceb tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: 753050ac-8ed4-4825-8136-44279adacb0f with Priority: HIGHEST for action security_group_rules [ 751.433478] env[69506]: INFO networking_nsxv3.common.synchronization [req-e2f9ecaa-c0f6-4f23-886f-c63a1902a2cb req-6d4320f6-0fd3-4ba6-80c1-3e3c7803eceb tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: 753050ac-8ed4-4825-8136-44279adacb0f with Priority: HIGHEST for action security_group_members [ 751.433701] env[69506]: INFO networking_nsxv3.common.synchronization [req-e2f9ecaa-c0f6-4f23-886f-c63a1902a2cb req-6d4320f6-0fd3-4ba6-80c1-3e3c7803eceb tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: 83b3fa78-db84-4486-94a7-0dc721bd750d with Priority: HIGHEST for action port [ 751.434342] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_rules [ 751.434673] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64557eb9-9b83-42ab-99e4-278f5711a22e with Priority: HIGHEST for action security_group_rules [ 751.434754] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 753050ac-8ed4-4825-8136-44279adacb0f with Priority: HIGHEST for action security_group_members [ 751.434841] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83b3fa78-db84-4486-94a7-0dc721bd750d with Priority: HIGHEST for action port [ 751.436084] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 753050ac-8ed4-4825-8136-44279adacb0f with Priority: HIGHEST for action security_group_rules [ 751.436084] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_members [ 751.436084] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64557eb9-9b83-42ab-99e4-278f5711a22e with Priority: HIGHEST for action security_group_members [ 751.436084] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a27cb9c-bb13-44cb-a531-49610a94a36e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.436084] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.436343] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64557eb9-9b83-42ab-99e4-278f5711a22e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.436435] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.436617] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-753050ac-8ed4-4825-8136-44279adacb0f taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.436698] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-753050ac-8ed4-4825-8136-44279adacb0f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.436872] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-83b3fa78-db84-4486-94a7-0dc721bd750d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.436950] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83b3fa78-db84-4486-94a7-0dc721bd750d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.438226] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-753050ac-8ed4-4825-8136-44279adacb0f taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.438344] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-753050ac-8ed4-4825-8136-44279adacb0f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.438412] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-753050ac-8ed4-4825-8136-44279adacb0f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.438667] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-753050ac-8ed4-4825-8136-44279adacb0f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.438750] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('753050ac-8ed4-4825-8136-44279adacb0f',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.439607] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a27cb9c-bb13-44cb-a531-49610a94a36e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.439699] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.439886] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-64557eb9-9b83-42ab-99e4-278f5711a22e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.439967] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.501658] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64557eb9-9b83-42ab-99e4-278f5711a22e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.502347] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.558812] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a27cb9c-bb13-44cb-a531-49610a94a36e taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.558812] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.559595] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-64557eb9-9b83-42ab-99e4-278f5711a22e taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.559595] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.560870] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 83b3fa78-db84-4486-94a7-0dc721bd750d with status ACTIVE [ 751.561138] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.561215] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.561299] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.561569] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.561628] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.561960] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.561960] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.561960] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.562195] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.562258] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.563079] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.563079] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.563079] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.563079] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.563079] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.563079] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 83b3fa78-db84-4486-94a7-0dc721bd750d is going to be updated. [ 751.585248] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.585398] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.585468] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.585665] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.585798] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.585953] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83b3fa78-db84-4486-94a7-0dc721bd750d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.586117] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83b3fa78-db84-4486-94a7-0dc721bd750d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.586272] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83b3fa78-db84-4486-94a7-0dc721bd750d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.586356] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83b3fa78-db84-4486-94a7-0dc721bd750d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.676477] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ba7662d-ea93-4828-a093-1d0b8a8fc40f taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.676477] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ba7662d-ea93-4828-a093-1d0b8a8fc40f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.676477] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1e384e5c-098b-4320-90bc-93c3d27366b1 with status ACTIVE [ 751.676477] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.676477] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.676477] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.676477] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.676477] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.676477] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.676477] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.676477] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.676935] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.676935] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.676935] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.676935] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.677070] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.677141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.677222] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.677339] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1e384e5c-098b-4320-90bc-93c3d27366b1 is going to be updated. [ 751.679335] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ba7662d-ea93-4828-a093-1d0b8a8fc40f',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.712891] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.713062] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.713126] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.713349] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.713462] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.713628] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e384e5c-098b-4320-90bc-93c3d27366b1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.897330] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('753050ac-8ed4-4825-8136-44279adacb0f',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.942775] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-753050ac-8ed4-4825-8136-44279adacb0f taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.943179] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-753050ac-8ed4-4825-8136-44279adacb0f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.004365] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64557eb9-9b83-42ab-99e4-278f5711a22e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.005329] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.089826] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 83b3fa78-db84-4486-94a7-0dc721bd750d with status ACTIVE [ 752.089826] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.090224] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.090480] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.090650] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.090994] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.090994] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.091146] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.091146] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.091259] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.091343] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.091522] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.091614] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.091673] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.091808] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.091881] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.091964] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 83b3fa78-db84-4486-94a7-0dc721bd750d is going to be updated. [ 752.119930] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.120352] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.120352] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.120714] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.120714] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.121460] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83b3fa78-db84-4486-94a7-0dc721bd750d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.142960] env[69506]: INFO networking_nsxv3.common.synchronization [req-a0a48905-6913-4855-9990-d7e7a2a1b8bb req-8e0db65a-3140-4d8f-ae8e-37f6fff3bb3b tempest-AttachInterfacesV270Test-1470960675 tempest-AttachInterfacesV270Test-1470960675-project-member] Enqueued Resource ID: 5387ebf9-b56f-4308-969a-3aa715cad9da with Priority: HIGHEST for action security_group_members [ 752.143740] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5387ebf9-b56f-4308-969a-3aa715cad9da with Priority: HIGHEST for action security_group_members [ 752.143981] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-5387ebf9-b56f-4308-969a-3aa715cad9da taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.144121] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5387ebf9-b56f-4308-969a-3aa715cad9da" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.144191] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5387ebf9-b56f-4308-969a-3aa715cad9da" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.145350] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5387ebf9-b56f-4308-969a-3aa715cad9da" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.145449] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.145506] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.145577] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.145710] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.145797] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.145889] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5387ebf9-b56f-4308-969a-3aa715cad9da',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.181598] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ba7662d-ea93-4828-a093-1d0b8a8fc40f',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.280839] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 in Status: SUCCESS [ 752.281115] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.285232] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.285232] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.285232] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.285232] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.285232] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.285232] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.285232] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.285232] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.285232] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78caaaf6-868f-4043-93dd-d9a75a05d023',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.399368] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('753050ac-8ed4-4825-8136-44279adacb0f',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.506962] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.507084] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.507172] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.507357] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.507469] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.507609] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64557eb9-9b83-42ab-99e4-278f5711a22e is going to be created. [ 752.512789] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.512907] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.512981] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.513181] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.514493] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.514617] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e is going to be updated. [ 752.533161] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.533359] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.533445] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.533680] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.533930] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.543576] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.543798] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.543882] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.544215] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.544442] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.547392] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64557eb9-9b83-42ab-99e4-278f5711a22e in Status: UNINITIALIZED for 2s [ 752.553747] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e in Status: IN_PROGRESS for 2s [ 752.649453] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.649453] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.649453] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.649453] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.649453] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.649453] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.649453] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.649453] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.649453] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.649453] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.649453] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5387ebf9-b56f-4308-969a-3aa715cad9da already deleted. [ 752.649963] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5387ebf9-b56f-4308-969a-3aa715cad9da" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.685161] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.685320] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.685392] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.685605] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.685693] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.685794] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ba7662d-ea93-4828-a093-1d0b8a8fc40f is going to be created. [ 752.709990] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.710164] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.710238] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.710458] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.710615] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.725293] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ba7662d-ea93-4828-a093-1d0b8a8fc40f in Status: UNINITIALIZED for 2s [ 752.754016] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-622 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.754016] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-622" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.754016] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-622" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.754016] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-622" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.754016] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.754016] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.754016] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.754016] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.754016] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.754016] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 752.754016] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 752.754479] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 752.754479] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 752.754479] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 752.754479] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 752.754620] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 752.779781] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 752.779948] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 752.780109] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 752.780293] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-622" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.780651] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-3f49ff5c-1b7d-4b70-8cd0-ee81b7c341b8 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.780828] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-3f49ff5c-1b7d-4b70-8cd0-ee81b7c341b8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.780949] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-3f49ff5c-1b7d-4b70-8cd0-ee81b7c341b8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.781287] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-3f49ff5c-1b7d-4b70-8cd0-ee81b7c341b8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.781431] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f49ff5c-1b7d-4b70-8cd0-ee81b7c341b8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.787857] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-78caaaf6-868f-4043-93dd-d9a75a05d023 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.787857] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.787857] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.787857] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.787857] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.787857] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.787857] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.787857] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.787857] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.787857] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.787857] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-78caaaf6-868f-4043-93dd-d9a75a05d023 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.787857] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.787857] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.787857] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.787857] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.787857] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.788701] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.788701] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.788701] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.788701] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.788701] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78caaaf6-868f-4043-93dd-d9a75a05d023',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.902600] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.902600] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.902600] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.902814] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.902814] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.903288] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 753050ac-8ed4-4825-8136-44279adacb0f is going to be created. [ 752.929343] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.929487] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.929558] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.929762] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.929913] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.939793] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 753050ac-8ed4-4825-8136-44279adacb0f in Status: UNINITIALIZED for 2s [ 753.285112] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.285418] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.285567] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.285898] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.286139] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.286357] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 3f49ff5c-1b7d-4b70-8cd0-ee81b7c341b8 not found, creating... [ 753.286649] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.286854] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.286980] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.287300] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.287470] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.287842] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.291509] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.291713] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.291992] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.292163] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.292360] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 3f49ff5c-1b7d-4b70-8cd0-ee81b7c341b8 is going to be created. [ 753.293690] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78caaaf6-868f-4043-93dd-d9a75a05d023: rpc.has_security_group_logging(os_id): False [ 753.316948] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.317178] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.317340] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.317701] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.318029] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.318247] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-3f49ff5c-1b7d-4b70-8cd0-ee81b7c341b8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.325380] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.325380] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.325380] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.325380] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.325380] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.325380] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.325380] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.325380] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.329028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.329028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.329028] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.329028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.329028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.329028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.329028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.329028] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.329028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.329028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.329028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.329028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.329028] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 is going to be created. [ 753.432653] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.433031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.433031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.433875] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.433875] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.476986] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 in Status: IN_PROGRESS for 2s [ 754.340546] env[69506]: INFO networking_nsxv3.common.synchronization [req-a0a48905-6913-4855-9990-d7e7a2a1b8bb req-176476df-c08d-4176-ac86-72578a5792e5 service nova] Enqueued Resource ID: 5387ebf9-b56f-4308-969a-3aa715cad9da with Priority: HIGHEST for action security_group_rules [ 754.340546] env[69506]: INFO networking_nsxv3.common.synchronization [req-a0a48905-6913-4855-9990-d7e7a2a1b8bb req-176476df-c08d-4176-ac86-72578a5792e5 service nova] Enqueued Resource ID: 5387ebf9-b56f-4308-969a-3aa715cad9da with Priority: HIGHEST for action security_group_members [ 754.340546] env[69506]: INFO networking_nsxv3.common.synchronization [req-a0a48905-6913-4855-9990-d7e7a2a1b8bb req-176476df-c08d-4176-ac86-72578a5792e5 service nova] Enqueued Resource ID: 3f49ff5c-1b7d-4b70-8cd0-ee81b7c341b8 with Priority: HIGHEST for action port [ 754.340546] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5387ebf9-b56f-4308-969a-3aa715cad9da with Priority: HIGHEST for action security_group_rules [ 754.340546] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5387ebf9-b56f-4308-969a-3aa715cad9da with Priority: HIGHEST for action security_group_members [ 754.340873] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f49ff5c-1b7d-4b70-8cd0-ee81b7c341b8 with Priority: HIGHEST for action port [ 754.342658] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5387ebf9-b56f-4308-969a-3aa715cad9da taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.342964] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5387ebf9-b56f-4308-969a-3aa715cad9da" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.343308] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5387ebf9-b56f-4308-969a-3aa715cad9da" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.343637] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5387ebf9-b56f-4308-969a-3aa715cad9da" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.343811] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5387ebf9-b56f-4308-969a-3aa715cad9da',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.345285] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-5387ebf9-b56f-4308-969a-3aa715cad9da taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.345695] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5387ebf9-b56f-4308-969a-3aa715cad9da" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.345855] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5387ebf9-b56f-4308-969a-3aa715cad9da" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.346218] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5387ebf9-b56f-4308-969a-3aa715cad9da" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.346567] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.346809] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.346944] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.347190] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.347393] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.347561] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5387ebf9-b56f-4308-969a-3aa715cad9da',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.350851] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f49ff5c-1b7d-4b70-8cd0-ee81b7c341b8 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.350851] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f49ff5c-1b7d-4b70-8cd0-ee81b7c341b8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.350851] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f49ff5c-1b7d-4b70-8cd0-ee81b7c341b8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.350851] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f49ff5c-1b7d-4b70-8cd0-ee81b7c341b8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.350851] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f49ff5c-1b7d-4b70-8cd0-ee81b7c341b8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.562563] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64557eb9-9b83-42ab-99e4-278f5711a22e in Status: SUCCESS [ 754.562861] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.562962] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.563228] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.563704] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.563880] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.563930] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.564140] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.564209] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.564312] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64557eb9-9b83-42ab-99e4-278f5711a22e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.565864] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e in Status: SUCCESS [ 754.566055] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.566241] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.566456] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.566626] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.566733] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.566798] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.566958] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.567036] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.567134] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.672231] env[69506]: INFO networking_nsxv3.common.synchronization [req-418b59ab-90af-448c-bf1c-702dcade3d11 req-56c4ca6c-5b8c-458f-bac2-d9b4ef8ada07 tempest-ServerRescueTestJSON-235851791 tempest-ServerRescueTestJSON-235851791-project-member] Enqueued Resource ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 with Priority: HIGHEST for action security_group_members [ 754.672760] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 with Priority: HIGHEST for action security_group_members [ 754.673068] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-65fb79f7-95e7-4be9-b5bb-64c57bc42333 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.673188] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.673257] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.673530] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.673644] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.673733] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.673798] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.673939] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.674431] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.674539] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65fb79f7-95e7-4be9-b5bb-64c57bc42333',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.733446] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ba7662d-ea93-4828-a093-1d0b8a8fc40f in Status: SUCCESS [ 754.733677] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ba7662d-ea93-4828-a093-1d0b8a8fc40f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.733859] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ba7662d-ea93-4828-a093-1d0b8a8fc40f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.734086] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ba7662d-ea93-4828-a093-1d0b8a8fc40f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.734283] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.734519] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.734519] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.734617] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.734706] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.734789] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ba7662d-ea93-4828-a093-1d0b8a8fc40f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.734892] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ba7662d-ea93-4828-a093-1d0b8a8fc40f',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.853204] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5387ebf9-b56f-4308-969a-3aa715cad9da',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.859311] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-5387ebf9-b56f-4308-969a-3aa715cad9da taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.859486] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5387ebf9-b56f-4308-969a-3aa715cad9da" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.860465] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3f49ff5c-1b7d-4b70-8cd0-ee81b7c341b8 with status ACTIVE [ 754.863488] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.863488] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.863488] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.863488] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.863488] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.863488] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.863488] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.863488] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.865872] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.865982] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.866281] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.866351] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.866382] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.866537] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.866748] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.866748] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3f49ff5c-1b7d-4b70-8cd0-ee81b7c341b8 is going to be updated. [ 754.891293] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.891452] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.891517] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.891682] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.892019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.892019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f49ff5c-1b7d-4b70-8cd0-ee81b7c341b8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.950409] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 753050ac-8ed4-4825-8136-44279adacb0f in Status: SUCCESS [ 754.951026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-753050ac-8ed4-4825-8136-44279adacb0f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.951026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-753050ac-8ed4-4825-8136-44279adacb0f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.951026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-753050ac-8ed4-4825-8136-44279adacb0f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.951198] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.951334] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.951638] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.951638] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.951638] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.951768] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('753050ac-8ed4-4825-8136-44279adacb0f',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.069504] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64557eb9-9b83-42ab-99e4-278f5711a22e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.069621] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.116455] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-201 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.116582] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-201" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.116697] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-201" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.117160] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-201" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.117791] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.118011] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.118270] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.118611] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.118847] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.119286] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 755.119499] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 755.119697] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 755.119891] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 755.120108] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 755.120593] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 755.120834] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 755.140221] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 755.140363] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 755.140467] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 755.140636] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-201" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.140928] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-d0287125-f3de-4b2c-a26c-742656e100ba taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.141109] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-d0287125-f3de-4b2c-a26c-742656e100ba" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.141230] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-d0287125-f3de-4b2c-a26c-742656e100ba" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.141511] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-d0287125-f3de-4b2c-a26c-742656e100ba" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.141650] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0287125-f3de-4b2c-a26c-742656e100ba',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.177286] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.177426] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.177500] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.177699] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.177791] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.177981] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.179300] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.179300] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.179300] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.179300] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.179300] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 already deleted. [ 755.179300] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.241403] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ba7662d-ea93-4828-a093-1d0b8a8fc40f taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.241403] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ba7662d-ea93-4828-a093-1d0b8a8fc40f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.241403] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ba7662d-ea93-4828-a093-1d0b8a8fc40f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.241403] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ba7662d-ea93-4828-a093-1d0b8a8fc40f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.241403] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.241403] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.241403] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.241403] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.241403] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.241403] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ba7662d-ea93-4828-a093-1d0b8a8fc40f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.241403] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ba7662d-ea93-4828-a093-1d0b8a8fc40f taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.241403] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ba7662d-ea93-4828-a093-1d0b8a8fc40f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.241403] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ba7662d-ea93-4828-a093-1d0b8a8fc40f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.241403] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ba7662d-ea93-4828-a093-1d0b8a8fc40f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.241403] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.241403] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.242026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.242026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.242026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.242026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ba7662d-ea93-4828-a093-1d0b8a8fc40f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.242026] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ba7662d-ea93-4828-a093-1d0b8a8fc40f',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.360971] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5387ebf9-b56f-4308-969a-3aa715cad9da',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.455128] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('753050ac-8ed4-4825-8136-44279adacb0f',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.488409] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 in Status: SUCCESS [ 755.488628] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.572289] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64557eb9-9b83-42ab-99e4-278f5711a22e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.573297] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.644440] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.646129] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.646129] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.646129] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.646129] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.646129] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port d0287125-f3de-4b2c-a26c-742656e100ba not found, creating... [ 755.646129] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.646129] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.646129] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.646472] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.646472] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.646588] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.646731] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.646888] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.647584] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.647758] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.648632] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: d0287125-f3de-4b2c-a26c-742656e100ba is going to be created. [ 755.669250] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.669481] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.669606] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.669865] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.670104] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.670331] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-d0287125-f3de-4b2c-a26c-742656e100ba" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.743247] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ba7662d-ea93-4828-a093-1d0b8a8fc40f: rpc.has_security_group_logging(os_id): False [ 755.771255] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.771474] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.771474] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.771647] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.771737] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.771927] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.772038] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.772104] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.772252] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.772331] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.772528] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.772621] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.772678] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.772817] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.772890] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.773089] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.773164] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.773234] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.773354] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.773427] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.773510] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ba7662d-ea93-4828-a093-1d0b8a8fc40f is going to be created. [ 755.860844] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.860998] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.861092] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.861311] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.861488] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.866411] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.866533] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.866604] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.866872] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.866872] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.866954] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5387ebf9-b56f-4308-969a-3aa715cad9da is going to be created. [ 755.875067] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ba7662d-ea93-4828-a093-1d0b8a8fc40f in Status: IN_PROGRESS for 2s [ 755.901046] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.901184] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.901184] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.901427] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.901593] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.911479] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5387ebf9-b56f-4308-969a-3aa715cad9da in Status: UNINITIALIZED for 2s [ 755.957172] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('753050ac-8ed4-4825-8136-44279adacb0f',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.074762] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.074895] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.074947] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.075220] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.075344] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.075472] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64557eb9-9b83-42ab-99e4-278f5711a22e is going to be updated. [ 756.076952] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.077127] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.077226] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.077423] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.077535] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.077647] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e is going to be updated. [ 756.113756] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.113953] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.113994] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.114338] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.114513] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.116618] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.116799] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.116913] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.117133] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.117296] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.127822] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64557eb9-9b83-42ab-99e4-278f5711a22e in Status: IN_PROGRESS for 2s [ 756.128557] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e in Status: IN_PROGRESS for 2s [ 756.416364] env[69506]: INFO networking_nsxv3.common.synchronization [req-418b59ab-90af-448c-bf1c-702dcade3d11 req-59803bc3-8545-497f-b45b-b830cdab3a1a service nova] Enqueued Resource ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 with Priority: HIGHEST for action security_group_rules [ 756.416364] env[69506]: INFO networking_nsxv3.common.synchronization [req-418b59ab-90af-448c-bf1c-702dcade3d11 req-59803bc3-8545-497f-b45b-b830cdab3a1a service nova] Enqueued Resource ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 with Priority: HIGHEST for action security_group_members [ 756.416364] env[69506]: INFO networking_nsxv3.common.synchronization [req-418b59ab-90af-448c-bf1c-702dcade3d11 req-59803bc3-8545-497f-b45b-b830cdab3a1a service nova] Enqueued Resource ID: d0287125-f3de-4b2c-a26c-742656e100ba with Priority: HIGHEST for action port [ 756.416773] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 with Priority: HIGHEST for action security_group_rules [ 756.417022] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 with Priority: HIGHEST for action security_group_members [ 756.417240] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0287125-f3de-4b2c-a26c-742656e100ba with Priority: HIGHEST for action port [ 756.417606] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65fb79f7-95e7-4be9-b5bb-64c57bc42333 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.418024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.418206] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.418611] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.418796] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65fb79f7-95e7-4be9-b5bb-64c57bc42333',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.421025] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-65fb79f7-95e7-4be9-b5bb-64c57bc42333 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.421025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.421025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.421025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.421025] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.421025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.421025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.421025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.421025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.421025] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65fb79f7-95e7-4be9-b5bb-64c57bc42333',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.422310] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0287125-f3de-4b2c-a26c-742656e100ba taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.422637] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0287125-f3de-4b2c-a26c-742656e100ba" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.422777] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0287125-f3de-4b2c-a26c-742656e100ba" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.423099] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0287125-f3de-4b2c-a26c-742656e100ba" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.423335] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0287125-f3de-4b2c-a26c-742656e100ba',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.459749] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.459927] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.459977] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.460215] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.460633] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.460633] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 753050ac-8ed4-4825-8136-44279adacb0f is going to be updated. [ 756.490801] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.490985] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.491077] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.491857] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.491857] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.503249] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 753050ac-8ed4-4825-8136-44279adacb0f in Status: IN_PROGRESS for 2s [ 756.925057] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('65fb79f7-95e7-4be9-b5bb-64c57bc42333',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.927035] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-65fb79f7-95e7-4be9-b5bb-64c57bc42333 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.927035] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.927432] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d0287125-f3de-4b2c-a26c-742656e100ba with status ACTIVE [ 756.927638] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.927766] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.927937] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.928024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.928144] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.928421] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.928524] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.928524] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.928684] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.928763] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.929127] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.929890] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.929890] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.929890] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.929890] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.929890] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d0287125-f3de-4b2c-a26c-742656e100ba is going to be updated. [ 756.959177] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.959336] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.959432] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.959596] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.959724] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.959884] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0287125-f3de-4b2c-a26c-742656e100ba" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.428258] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('65fb79f7-95e7-4be9-b5bb-64c57bc42333',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.887092] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ba7662d-ea93-4828-a093-1d0b8a8fc40f in Status: SUCCESS [ 757.887340] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ba7662d-ea93-4828-a093-1d0b8a8fc40f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.930523] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.930817] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.930817] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.931482] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.931482] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.931482] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 is going to be created. [ 757.936682] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5387ebf9-b56f-4308-969a-3aa715cad9da in Status: SUCCESS [ 757.936877] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5387ebf9-b56f-4308-969a-3aa715cad9da" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.937041] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5387ebf9-b56f-4308-969a-3aa715cad9da" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.937259] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5387ebf9-b56f-4308-969a-3aa715cad9da" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.937403] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.938036] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.938036] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.938036] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.938147] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.938202] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5387ebf9-b56f-4308-969a-3aa715cad9da" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.938977] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5387ebf9-b56f-4308-969a-3aa715cad9da',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.960195] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.960406] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.960527] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.960678] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.960828] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.969890] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 in Status: UNINITIALIZED for 2s [ 758.140846] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64557eb9-9b83-42ab-99e4-278f5711a22e in Status: SUCCESS [ 758.141078] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.141250] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.141461] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.141645] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.141752] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.141814] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.141961] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.142049] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.142143] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64557eb9-9b83-42ab-99e4-278f5711a22e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.144364] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e in Status: SUCCESS [ 758.144617] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.144752] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.144974] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.145156] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.145305] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.145346] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.145580] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.145682] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.145774] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.441693] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-5387ebf9-b56f-4308-969a-3aa715cad9da taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.441866] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5387ebf9-b56f-4308-969a-3aa715cad9da" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.441866] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5387ebf9-b56f-4308-969a-3aa715cad9da" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.442107] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5387ebf9-b56f-4308-969a-3aa715cad9da" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.442274] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.442378] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.442442] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.442592] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.442694] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.442779] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5387ebf9-b56f-4308-969a-3aa715cad9da" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.442925] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-5387ebf9-b56f-4308-969a-3aa715cad9da taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.443018] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5387ebf9-b56f-4308-969a-3aa715cad9da" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.443077] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5387ebf9-b56f-4308-969a-3aa715cad9da" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.443213] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5387ebf9-b56f-4308-969a-3aa715cad9da" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.443350] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.443440] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.443498] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.443628] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.443704] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.443777] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5387ebf9-b56f-4308-969a-3aa715cad9da" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.443863] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5387ebf9-b56f-4308-969a-3aa715cad9da',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.512330] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 753050ac-8ed4-4825-8136-44279adacb0f in Status: SUCCESS [ 758.512566] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-753050ac-8ed4-4825-8136-44279adacb0f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.512743] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-753050ac-8ed4-4825-8136-44279adacb0f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.513031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-753050ac-8ed4-4825-8136-44279adacb0f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.513285] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.513420] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.513490] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.513675] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.513763] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.515024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-753050ac-8ed4-4825-8136-44279adacb0f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.515024] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('753050ac-8ed4-4825-8136-44279adacb0f',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.647278] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64557eb9-9b83-42ab-99e4-278f5711a22e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.648603] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.946601] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5387ebf9-b56f-4308-969a-3aa715cad9da: rpc.has_security_group_logging(os_id): False [ 758.966465] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.966592] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.966672] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.966899] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.967030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.967268] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.967385] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.967474] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.967676] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.967770] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.967970] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.968087] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.968148] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.968408] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.968484] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.968692] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.968873] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.968951] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.969105] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.969200] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.969368] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5387ebf9-b56f-4308-969a-3aa715cad9da is going to be created. [ 759.017412] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('753050ac-8ed4-4825-8136-44279adacb0f',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.030767] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.030767] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.030767] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.030767] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.030767] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.042014] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5387ebf9-b56f-4308-969a-3aa715cad9da in Status: IN_PROGRESS for 2s [ 759.150305] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64557eb9-9b83-42ab-99e4-278f5711a22e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.151388] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.522125] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 753050ac-8ed4-4825-8136-44279adacb0f: rpc.has_security_group_logging(os_id): False [ 759.547106] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.547106] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.547106] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.547106] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.547106] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.547106] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.547106] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.547106] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.547106] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.547106] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.547106] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 753050ac-8ed4-4825-8136-44279adacb0f is going to be created. [ 759.608025] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.608025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.608025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.608025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.608025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.620071] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 753050ac-8ed4-4825-8136-44279adacb0f in Status: IN_PROGRESS for 2s [ 759.659021] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.659021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.659021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.659021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.659021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.659021] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64557eb9-9b83-42ab-99e4-278f5711a22e is going to be updated. [ 759.659021] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.659021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.659021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.659021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.659021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.659021] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e is going to be updated. [ 759.711405] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.712702] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.712702] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.712702] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.712881] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.715041] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.715041] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.715041] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.715041] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.715265] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.731818] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e in Status: IN_PROGRESS for 2s [ 759.732530] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64557eb9-9b83-42ab-99e4-278f5711a22e in Status: IN_PROGRESS for 2s [ 759.979195] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 in Status: SUCCESS [ 759.979520] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.979638] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.979838] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.980067] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.980203] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.980271] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.980461] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.980557] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.980666] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.980777] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('65fb79f7-95e7-4be9-b5bb-64c57bc42333',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.486801] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-65fb79f7-95e7-4be9-b5bb-64c57bc42333 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.486801] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.486801] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.486801] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.486801] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.486801] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.486801] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.486801] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.486801] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.486801] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.486801] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-65fb79f7-95e7-4be9-b5bb-64c57bc42333 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.486801] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.486801] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.486801] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.486801] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.486801] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.487537] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.487537] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.487537] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.487537] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.487537] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('65fb79f7-95e7-4be9-b5bb-64c57bc42333',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.989907] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 65fb79f7-95e7-4be9-b5bb-64c57bc42333: rpc.has_security_group_logging(os_id): False [ 761.012100] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.012335] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.012419] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.012631] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.012755] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.013051] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.013181] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.013244] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.013377] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.013456] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.013649] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.013784] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.013784] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.013932] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.014021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.014405] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.014522] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.014588] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.014794] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.015098] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.015098] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 is going to be created. [ 761.052287] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5387ebf9-b56f-4308-969a-3aa715cad9da in Status: SUCCESS [ 761.052665] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5387ebf9-b56f-4308-969a-3aa715cad9da" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.076062] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.078186] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.078186] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.078186] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.078186] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.088174] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 in Status: IN_PROGRESS for 2s [ 761.213948] env[69506]: INFO networking_nsxv3.common.synchronization [None req-a26a9576-a0e0-49d2-8487-01eb0056de3a None None] Enqueued Resource ID: f71131c5-102c-4ad7-876c-0137b4bd54fd with Priority: HIGHEST for action port [ 761.214495] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f71131c5-102c-4ad7-876c-0137b4bd54fd with Priority: HIGHEST for action port [ 761.214876] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-f71131c5-102c-4ad7-876c-0137b4bd54fd taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.215012] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f71131c5-102c-4ad7-876c-0137b4bd54fd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.215400] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f71131c5-102c-4ad7-876c-0137b4bd54fd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.215834] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f71131c5-102c-4ad7-876c-0137b4bd54fd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.215834] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f71131c5-102c-4ad7-876c-0137b4bd54fd',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.456072] env[69506]: INFO networking_nsxv3.common.synchronization [req-adfef50a-a4ff-4eee-b06b-284db4b48f4d req-f2c1aa9f-ff9a-410c-a1dd-160cf40412cd tempest-ServersAdminTestJSON-446545879 tempest-ServersAdminTestJSON-446545879-project-member] Enqueued Resource ID: 706a5462-e893-428d-beb2-737cbec00439 with Priority: HIGHEST for action security_group_members [ 761.456669] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 706a5462-e893-428d-beb2-737cbec00439 with Priority: HIGHEST for action security_group_members [ 761.456913] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-706a5462-e893-428d-beb2-737cbec00439 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.457047] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.458483] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.458750] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.458986] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.459076] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.459112] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.459274] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.459457] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.459569] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.641609] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 753050ac-8ed4-4825-8136-44279adacb0f in Status: SUCCESS [ 761.642051] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-753050ac-8ed4-4825-8136-44279adacb0f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.718662] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f71131c5-102c-4ad7-876c-0137b4bd54fd [ 761.718892] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.719047] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.719128] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.719306] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.719385] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.719476] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f71131c5-102c-4ad7-876c-0137b4bd54fd already deleted. [ 761.719555] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f71131c5-102c-4ad7-876c-0137b4bd54fd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.743213] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e in Status: SUCCESS [ 761.743440] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.744180] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64557eb9-9b83-42ab-99e4-278f5711a22e in Status: SUCCESS [ 761.744347] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.744509] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.744807] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.745090] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.748627] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.748627] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.748627] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.748627] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.748816] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.750391] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.750391] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.750391] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.750391] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.750391] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.750616] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.750616] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.750980] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64557eb9-9b83-42ab-99e4-278f5711a22e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.842815] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-149 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.842815] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-149" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.842815] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-149" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.842815] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-149" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.842815] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.842815] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.842815] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.843461] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.843461] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.843693] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 761.843810] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 761.845816] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 761.845816] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 761.845816] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 761.845816] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 761.845816] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 761.862790] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 761.862943] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 761.863092] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 761.863262] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-149" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.863599] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-df22cc70-1ff3-48fc-a922-bf90fddda1c1 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.863773] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-df22cc70-1ff3-48fc-a922-bf90fddda1c1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.863891] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-df22cc70-1ff3-48fc-a922-bf90fddda1c1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.864215] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-df22cc70-1ff3-48fc-a922-bf90fddda1c1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.864366] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df22cc70-1ff3-48fc-a922-bf90fddda1c1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.962078] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.253337] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.254615] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64557eb9-9b83-42ab-99e4-278f5711a22e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.369016] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.369016] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.369016] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.369016] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.369016] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.369308] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port df22cc70-1ff3-48fc-a922-bf90fddda1c1 not found, creating... [ 762.370334] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.371671] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.371897] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.372310] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.372827] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.373174] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.373367] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.373502] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.373751] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.374953] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.374953] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: df22cc70-1ff3-48fc-a922-bf90fddda1c1 is going to be created. [ 762.393986] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.394228] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.394356] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.394629] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.394921] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.395172] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-df22cc70-1ff3-48fc-a922-bf90fddda1c1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.423070] env[69506]: INFO networking_nsxv3.common.synchronization [req-e6080510-2367-45f6-b6a7-391de2b8605a req-5b7d2c7d-c159-4c69-b3cb-0cdab47cf463 tempest-FloatingIPsAssociationTestJSON-642147526 tempest-FloatingIPsAssociationTestJSON-642147526-project-member] Enqueued Resource ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 with Priority: HIGHEST for action security_group_members [ 762.423593] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 with Priority: HIGHEST for action security_group_members [ 762.423967] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-56c2fe94-2993-4f31-a331-b0611a88cec2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.424357] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.424432] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.426248] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.426248] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.426248] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.426248] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.426248] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.426248] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.426248] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56c2fe94-2993-4f31-a331-b0611a88cec2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.464455] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.755053] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.756748] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64557eb9-9b83-42ab-99e4-278f5711a22e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.927931] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.928113] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.928184] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.928442] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.928542] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.928739] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.929050] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.929050] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.929050] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.929200] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.929200] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 is going to be updated. [ 762.966701] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.966866] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.966866] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.967063] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.967171] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.967280] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 706a5462-e893-428d-beb2-737cbec00439 is going to be updated. [ 762.970938] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.971059] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.971164] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.971515] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.971698] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.986842] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 in Status: IN_PROGRESS for 2s [ 763.007009] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.007088] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.007186] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.007648] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.007843] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.016912] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 706a5462-e893-428d-beb2-737cbec00439 in Status: IN_PROGRESS for 2s [ 763.105482] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 in Status: SUCCESS [ 763.107706] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.107706] env[69506]: INFO networking_nsxv3.common.synchronization [req-adfef50a-a4ff-4eee-b06b-284db4b48f4d req-786b8656-2054-4b26-9f8e-4fa03670d243 service nova] Enqueued Resource ID: 706a5462-e893-428d-beb2-737cbec00439 with Priority: HIGHEST for action security_group_rules [ 763.107706] env[69506]: INFO networking_nsxv3.common.synchronization [req-adfef50a-a4ff-4eee-b06b-284db4b48f4d req-786b8656-2054-4b26-9f8e-4fa03670d243 service nova] Enqueued Resource ID: 706a5462-e893-428d-beb2-737cbec00439 with Priority: HIGHEST for action security_group_members [ 763.107706] env[69506]: INFO networking_nsxv3.common.synchronization [req-adfef50a-a4ff-4eee-b06b-284db4b48f4d req-786b8656-2054-4b26-9f8e-4fa03670d243 service nova] Enqueued Resource ID: df22cc70-1ff3-48fc-a922-bf90fddda1c1 with Priority: HIGHEST for action port [ 763.108838] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 706a5462-e893-428d-beb2-737cbec00439 with Priority: HIGHEST for action security_group_rules [ 763.109143] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 706a5462-e893-428d-beb2-737cbec00439 with Priority: HIGHEST for action security_group_members [ 763.112788] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df22cc70-1ff3-48fc-a922-bf90fddda1c1 with Priority: HIGHEST for action port [ 763.112788] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-706a5462-e893-428d-beb2-737cbec00439 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.112788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.112788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.112788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.112788] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.112788] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-706a5462-e893-428d-beb2-737cbec00439 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.112788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.112788] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-df22cc70-1ff3-48fc-a922-bf90fddda1c1 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.112788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df22cc70-1ff3-48fc-a922-bf90fddda1c1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.112788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df22cc70-1ff3-48fc-a922-bf90fddda1c1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.112788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df22cc70-1ff3-48fc-a922-bf90fddda1c1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.112788] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df22cc70-1ff3-48fc-a922-bf90fddda1c1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.258097] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.258452] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.258452] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.258743] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.258877] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.259018] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e is going to be updated. [ 763.264151] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.264151] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.264151] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.264151] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.264151] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.264151] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64557eb9-9b83-42ab-99e4-278f5711a22e is going to be updated. [ 763.295448] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.295585] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.295662] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.295866] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.296016] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.298028] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.298028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.298028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.298209] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.298242] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.310075] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64557eb9-9b83-42ab-99e4-278f5711a22e in Status: IN_PROGRESS for 2s [ 763.311697] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e in Status: IN_PROGRESS for 2s [ 763.329035] env[69506]: INFO networking_nsxv3.common.synchronization [None req-8ba2fa31-3a84-4667-8778-f93ca4722810 None None] Enqueued Resource ID: 249813c6-af3d-43b1-8135-35381dec9e8b with Priority: HIGHEST for action port [ 763.329299] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 249813c6-af3d-43b1-8135-35381dec9e8b with Priority: HIGHEST for action port [ 763.331497] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-249813c6-af3d-43b1-8135-35381dec9e8b taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.331497] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-249813c6-af3d-43b1-8135-35381dec9e8b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.331497] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-249813c6-af3d-43b1-8135-35381dec9e8b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.331497] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-249813c6-af3d-43b1-8135-35381dec9e8b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.331497] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('249813c6-af3d-43b1-8135-35381dec9e8b',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.613857] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-706a5462-e893-428d-beb2-737cbec00439 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.613983] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.614189] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port df22cc70-1ff3-48fc-a922-bf90fddda1c1 with status ACTIVE [ 763.614350] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.614457] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.614518] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.614731] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.614821] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.614989] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.615094] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.615209] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.615299] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.615378] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.615561] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.615649] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.615708] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.615845] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.615920] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.616019] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: df22cc70-1ff3-48fc-a922-bf90fddda1c1 is going to be updated. [ 763.637961] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.638150] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.638241] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.638630] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.638677] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.638848] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df22cc70-1ff3-48fc-a922-bf90fddda1c1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.833027] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 249813c6-af3d-43b1-8135-35381dec9e8b [ 763.833027] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.833316] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.833480] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.833724] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.833850] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.833955] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:249813c6-af3d-43b1-8135-35381dec9e8b already deleted. [ 763.834062] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-249813c6-af3d-43b1-8135-35381dec9e8b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.094139] env[69506]: INFO networking_nsxv3.common.synchronization [req-319704eb-669c-40a1-84d5-82f53166f0cc req-e96bb174-8fa2-4da5-8f34-e6c0ca64fff7 tempest-ServersTestBootFromVolume-165190847 tempest-ServersTestBootFromVolume-165190847-project-member] Enqueued Resource ID: 9f130eeb-c453-4570-b0fe-743f47890102 with Priority: HIGHEST for action security_group_members [ 764.094736] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f130eeb-c453-4570-b0fe-743f47890102 with Priority: HIGHEST for action security_group_members [ 764.095445] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f130eeb-c453-4570-b0fe-743f47890102 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.095445] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f130eeb-c453-4570-b0fe-743f47890102" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.095445] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f130eeb-c453-4570-b0fe-743f47890102" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.095789] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f130eeb-c453-4570-b0fe-743f47890102" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.096051] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.096255] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.096361] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.096607] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.096743] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.096911] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f130eeb-c453-4570-b0fe-743f47890102',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.171449] env[69506]: INFO networking_nsxv3.common.synchronization [req-73ebdd26-80f5-4cf5-b468-72ed9c611e94 req-2987616a-eb7d-4248-8559-0b30bc8278eb tempest-ServersNegativeTestMultiTenantJSON-1179789130 tempest-ServersNegativeTestMultiTenantJSON-1179789130-project-member] Enqueued Resource ID: 9ba7662d-ea93-4828-a093-1d0b8a8fc40f with Priority: HIGHEST for action security_group_members [ 764.171969] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ba7662d-ea93-4828-a093-1d0b8a8fc40f with Priority: HIGHEST for action security_group_members [ 764.172743] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ba7662d-ea93-4828-a093-1d0b8a8fc40f taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.173476] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ba7662d-ea93-4828-a093-1d0b8a8fc40f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.173476] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ba7662d-ea93-4828-a093-1d0b8a8fc40f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.173476] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ba7662d-ea93-4828-a093-1d0b8a8fc40f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.173640] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.173750] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.173807] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.174243] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.174243] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.174243] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ba7662d-ea93-4828-a093-1d0b8a8fc40f',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.599738] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.600213] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.600480] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.600678] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.600795] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.600999] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.601114] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.601179] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.601420] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.601420] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.601768] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f130eeb-c453-4570-b0fe-743f47890102 already deleted. [ 764.601870] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f130eeb-c453-4570-b0fe-743f47890102" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.677053] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.677053] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.677053] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.677243] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.677367] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.677550] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.677632] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.677713] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.677804] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.677881] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.677966] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ba7662d-ea93-4828-a093-1d0b8a8fc40f is going to be updated. [ 764.705727] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.705943] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.707090] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.707090] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.707090] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.714643] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ba7662d-ea93-4828-a093-1d0b8a8fc40f in Status: IN_PROGRESS for 2s [ 764.855416] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-745 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.856318] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-745" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.856318] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-745" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.856318] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-745" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.856555] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.856555] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.856722] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.856850] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.857067] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.858332] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 764.858550] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 764.858739] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 764.858926] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 764.859138] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 764.859322] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 764.859550] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 764.890299] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 764.890475] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 764.890630] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 764.890807] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-745" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.891146] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-7e56009d-e04e-48e0-a2d2-bd24f574510a taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.891327] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-7e56009d-e04e-48e0-a2d2-bd24f574510a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.891472] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-7e56009d-e04e-48e0-a2d2-bd24f574510a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.891766] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-7e56009d-e04e-48e0-a2d2-bd24f574510a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.891908] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e56009d-e04e-48e0-a2d2-bd24f574510a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.000448] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 in Status: SUCCESS [ 765.000448] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 deletion is rescheduled due to dependency. [ 765.000448] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.027180] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 706a5462-e893-428d-beb2-737cbec00439 in Status: SUCCESS [ 765.027408] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.027580] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.027797] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.027987] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.028506] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.028587] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.028748] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.028838] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.028931] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.322429] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e in Status: SUCCESS [ 765.322681] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.323411] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.323411] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.323411] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.323411] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.323646] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.323646] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.323708] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.323772] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.323888] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.325282] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64557eb9-9b83-42ab-99e4-278f5711a22e in Status: SUCCESS [ 765.325524] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.325608] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.325783] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.325949] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.326063] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.326129] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.326368] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.326478] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.326540] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.326661] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('64557eb9-9b83-42ab-99e4-278f5711a22e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.394869] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.395097] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.395227] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.395512] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.395662] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.395818] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 7e56009d-e04e-48e0-a2d2-bd24f574510a not found, creating... [ 765.396088] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.396246] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.396352] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.396570] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.396705] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.396979] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.397146] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.397260] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.397463] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.397618] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.397730] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 7e56009d-e04e-48e0-a2d2-bd24f574510a is going to be created. [ 765.422846] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.423109] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.423251] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.423581] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.423815] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.424048] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-7e56009d-e04e-48e0-a2d2-bd24f574510a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.534501] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.828240] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a27cb9c-bb13-44cb-a531-49610a94a36e taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.828558] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.828558] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.828720] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.828882] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.828977] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.829054] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.829224] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.829317] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.829410] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.829557] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a27cb9c-bb13-44cb-a531-49610a94a36e taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.829647] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.829703] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.829843] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.829974] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.830094] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.830155] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.830548] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.830548] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.830548] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.830548] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.831431] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('64557eb9-9b83-42ab-99e4-278f5711a22e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.037521] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.333629] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a27cb9c-bb13-44cb-a531-49610a94a36e: rpc.has_security_group_logging(os_id): False [ 766.334814] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 64557eb9-9b83-42ab-99e4-278f5711a22e: rpc.has_security_group_logging(os_id): False [ 766.398910] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.399122] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.399199] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.399454] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.399548] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.399788] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.399887] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.399953] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.400119] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.400198] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.400366] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64557eb9-9b83-42ab-99e4-278f5711a22e is going to be created. [ 766.402801] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.402990] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.403120] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.403464] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.403741] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.404095] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.404163] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.404245] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.404427] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.404629] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.405016] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.405178] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.405301] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.405831] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.405985] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.406241] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.406384] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.406638] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.406831] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.406956] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.407094] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e is going to be updated. [ 766.493373] env[69506]: INFO networking_nsxv3.common.synchronization [req-ce1220c3-c41d-4199-a414-d8bfc75fc2ea req-d77f0945-45b2-44b7-98a0-2a5008e519ed tempest-AttachInterfacesUnderV243Test-153413102 tempest-AttachInterfacesUnderV243Test-153413102-project-member] Enqueued Resource ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 with Priority: HIGHEST for action security_group_members [ 766.494713] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 with Priority: HIGHEST for action security_group_members [ 766.499087] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-74c7c33d-c19d-4ab6-af56-0941c2240118 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.499503] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.499503] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.499635] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.499764] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.499874] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.499937] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.500118] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.500205] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.500302] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74c7c33d-c19d-4ab6-af56-0941c2240118',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.522266] env[69506]: INFO networking_nsxv3.common.synchronization [req-319704eb-669c-40a1-84d5-82f53166f0cc req-5634f352-f39d-402f-8398-be585aee63f9 service nova] Enqueued Resource ID: 9f130eeb-c453-4570-b0fe-743f47890102 with Priority: HIGHEST for action security_group_rules [ 766.522447] env[69506]: INFO networking_nsxv3.common.synchronization [req-319704eb-669c-40a1-84d5-82f53166f0cc req-5634f352-f39d-402f-8398-be585aee63f9 service nova] Enqueued Resource ID: 9f130eeb-c453-4570-b0fe-743f47890102 with Priority: HIGHEST for action security_group_members [ 766.522584] env[69506]: INFO networking_nsxv3.common.synchronization [req-319704eb-669c-40a1-84d5-82f53166f0cc req-5634f352-f39d-402f-8398-be585aee63f9 service nova] Enqueued Resource ID: 7e56009d-e04e-48e0-a2d2-bd24f574510a with Priority: HIGHEST for action port [ 766.523044] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f130eeb-c453-4570-b0fe-743f47890102 with Priority: HIGHEST for action security_group_rules [ 766.523270] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f130eeb-c453-4570-b0fe-743f47890102 with Priority: HIGHEST for action security_group_members [ 766.523270] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e56009d-e04e-48e0-a2d2-bd24f574510a with Priority: HIGHEST for action port [ 766.523758] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f130eeb-c453-4570-b0fe-743f47890102 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.523885] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f130eeb-c453-4570-b0fe-743f47890102" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.523953] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f130eeb-c453-4570-b0fe-743f47890102" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.525017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f130eeb-c453-4570-b0fe-743f47890102" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.525017] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f130eeb-c453-4570-b0fe-743f47890102',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.528032] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f130eeb-c453-4570-b0fe-743f47890102 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.528032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f130eeb-c453-4570-b0fe-743f47890102" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.528032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f130eeb-c453-4570-b0fe-743f47890102" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.528032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f130eeb-c453-4570-b0fe-743f47890102" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.528032] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.528032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.528032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.528032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.528032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.528032] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f130eeb-c453-4570-b0fe-743f47890102',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.531691] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e56009d-e04e-48e0-a2d2-bd24f574510a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.531691] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e56009d-e04e-48e0-a2d2-bd24f574510a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.531691] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e56009d-e04e-48e0-a2d2-bd24f574510a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.531691] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e56009d-e04e-48e0-a2d2-bd24f574510a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.531691] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e56009d-e04e-48e0-a2d2-bd24f574510a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.531691] env[69506]: INFO networking_nsxv3.common.synchronization [req-ce1220c3-c41d-4199-a414-d8bfc75fc2ea req-d77f0945-45b2-44b7-98a0-2a5008e519ed tempest-AttachInterfacesUnderV243Test-153413102 tempest-AttachInterfacesUnderV243Test-153413102-project-member] Enqueued Resource ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 with Priority: HIGHEST for action security_group_rules [ 766.531691] env[69506]: INFO networking_nsxv3.common.synchronization [req-ce1220c3-c41d-4199-a414-d8bfc75fc2ea req-d77f0945-45b2-44b7-98a0-2a5008e519ed tempest-AttachInterfacesUnderV243Test-153413102 tempest-AttachInterfacesUnderV243Test-153413102-project-member] Enqueued Resource ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 with Priority: HIGHEST for action security_group_members [ 766.532109] env[69506]: INFO networking_nsxv3.common.synchronization [req-ce1220c3-c41d-4199-a414-d8bfc75fc2ea req-d77f0945-45b2-44b7-98a0-2a5008e519ed tempest-AttachInterfacesUnderV243Test-153413102 tempest-AttachInterfacesUnderV243Test-153413102-project-member] Enqueued Resource ID: d10a6ff2-e16a-473b-aaca-5898c5e09055 with Priority: HIGHEST for action port [ 766.532774] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 with Priority: HIGHEST for action security_group_rules [ 766.532774] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 with Priority: HIGHEST for action security_group_members [ 766.533117] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d10a6ff2-e16a-473b-aaca-5898c5e09055 with Priority: HIGHEST for action port [ 766.533687] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-74c7c33d-c19d-4ab6-af56-0941c2240118 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.534400] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.534746] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.538031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.538165] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('74c7c33d-c19d-4ab6-af56-0941c2240118',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.539050] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-74c7c33d-c19d-4ab6-af56-0941c2240118 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.539154] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.539369] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-d10a6ff2-e16a-473b-aaca-5898c5e09055 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.539476] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d10a6ff2-e16a-473b-aaca-5898c5e09055" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.539538] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d10a6ff2-e16a-473b-aaca-5898c5e09055" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.539713] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d10a6ff2-e16a-473b-aaca-5898c5e09055" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.539800] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d10a6ff2-e16a-473b-aaca-5898c5e09055',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.541493] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.541708] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.541776] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.541949] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.542156] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.544221] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.544221] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.544221] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.544396] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.544396] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.546769] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 706a5462-e893-428d-beb2-737cbec00439 is going to be updated. [ 766.550867] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.551062] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.551174] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.551412] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.551615] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.594684] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e in Status: IN_PROGRESS for 2s [ 766.596111] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64557eb9-9b83-42ab-99e4-278f5711a22e in Status: IN_PROGRESS for 2s [ 766.652676] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.652827] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.652894] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.653130] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.653267] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.674138] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 706a5462-e893-428d-beb2-737cbec00439 in Status: IN_PROGRESS for 2s [ 766.744176] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ba7662d-ea93-4828-a093-1d0b8a8fc40f in Status: SUCCESS [ 766.744414] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ba7662d-ea93-4828-a093-1d0b8a8fc40f deletion is rescheduled due to dependency. [ 766.744583] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ba7662d-ea93-4828-a093-1d0b8a8fc40f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.003995] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('74c7c33d-c19d-4ab6-af56-0941c2240118',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.027745] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f130eeb-c453-4570-b0fe-743f47890102 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.027945] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f130eeb-c453-4570-b0fe-743f47890102" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.033835] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f130eeb-c453-4570-b0fe-743f47890102',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.035180] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7e56009d-e04e-48e0-a2d2-bd24f574510a with status ACTIVE [ 767.035362] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.035491] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.035767] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.036134] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.037282] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.037282] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.037282] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.037282] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.039465] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.041017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.041017] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.041017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.041017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.041298] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.042557] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.042698] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7e56009d-e04e-48e0-a2d2-bd24f574510a is going to be updated. [ 767.044314] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-74c7c33d-c19d-4ab6-af56-0941c2240118 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.044540] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.047517] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d10a6ff2-e16a-473b-aaca-5898c5e09055 with status ACTIVE [ 767.048108] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.048108] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.048108] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.048752] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.048752] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.048752] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.048752] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.048752] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.048983] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.048983] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.049134] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.049265] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.050182] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.050182] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.050182] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.050182] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d10a6ff2-e16a-473b-aaca-5898c5e09055 is going to be updated. [ 767.087316] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.087524] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.087524] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.087980] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.087980] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.088103] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e56009d-e04e-48e0-a2d2-bd24f574510a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.089187] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.089315] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.089315] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.089603] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.089852] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.090036] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d10a6ff2-e16a-473b-aaca-5898c5e09055" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.508177] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('74c7c33d-c19d-4ab6-af56-0941c2240118',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.545100] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f130eeb-c453-4570-b0fe-743f47890102',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.781290] env[69506]: INFO networking_nsxv3.common.synchronization [req-a5176577-24c7-4614-8a7c-267498324732 req-a14421ad-6c43-4bbe-b0a8-b68c3cf3e1a8 tempest-AttachInterfacesV270Test-1470960675 tempest-AttachInterfacesV270Test-1470960675-project-member] Enqueued Resource ID: 5387ebf9-b56f-4308-969a-3aa715cad9da with Priority: HIGHEST for action security_group_members [ 767.783400] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5387ebf9-b56f-4308-969a-3aa715cad9da with Priority: HIGHEST for action security_group_members [ 767.783881] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-5387ebf9-b56f-4308-969a-3aa715cad9da taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.784055] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5387ebf9-b56f-4308-969a-3aa715cad9da" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.784200] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5387ebf9-b56f-4308-969a-3aa715cad9da" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.784362] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5387ebf9-b56f-4308-969a-3aa715cad9da" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.784592] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.784676] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.784736] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.784885] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.784984] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.785090] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5387ebf9-b56f-4308-969a-3aa715cad9da',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.009458] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.009748] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.009748] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.009884] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.009981] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.010123] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 is going to be updated. [ 768.049278] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.049453] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.049544] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.049787] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.049884] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.049997] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f130eeb-c453-4570-b0fe-743f47890102 is going to be created. [ 768.059997] env[69506]: INFO networking_nsxv3.common.synchronization [req-63a45b96-ac8f-4d88-8502-3418cd6a64ed req-012c04a9-0a4b-47ec-9ac0-749e2a869916 tempest-ServerGroupTestJSON-915350675 tempest-ServerGroupTestJSON-915350675-project-member] Enqueued Resource ID: 40ac1d9f-7f09-4603-ba34-b3f5910e1da2 with Priority: HIGHEST for action security_group_members [ 768.061181] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.061310] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.061382] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.061580] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.061716] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.063986] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40ac1d9f-7f09-4603-ba34-b3f5910e1da2 with Priority: HIGHEST for action security_group_members [ 768.064554] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-40ac1d9f-7f09-4603-ba34-b3f5910e1da2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.064673] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40ac1d9f-7f09-4603-ba34-b3f5910e1da2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.064741] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40ac1d9f-7f09-4603-ba34-b3f5910e1da2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.065010] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40ac1d9f-7f09-4603-ba34-b3f5910e1da2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.065188] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.065289] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.065360] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.065570] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.065664] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.065760] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40ac1d9f-7f09-4603-ba34-b3f5910e1da2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.077581] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 in Status: IN_PROGRESS for 2s [ 768.080184] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.080349] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.080398] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.080684] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.081676] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.093109] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f130eeb-c453-4570-b0fe-743f47890102 in Status: UNINITIALIZED for 2s [ 768.290471] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.290471] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.290645] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.291291] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.291291] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.291291] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.291291] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.291291] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.291616] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.291616] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.291616] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5387ebf9-b56f-4308-969a-3aa715cad9da is going to be updated. [ 768.326133] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.326285] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.326374] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.326582] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.326716] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.336398] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5387ebf9-b56f-4308-969a-3aa715cad9da in Status: IN_PROGRESS for 2s [ 768.447033] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-880 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.447033] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.447033] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.447033] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.447033] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.447366] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.447366] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.447497] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.447622] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.447837] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 768.447950] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 768.448070] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 768.448182] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 768.448361] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 768.448616] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 768.448773] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 768.470899] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 768.471018] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 768.471164] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 768.471343] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.471644] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-9aff75b6-7eeb-4724-a999-73c60986a280 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.471813] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-9aff75b6-7eeb-4724-a999-73c60986a280" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.471930] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-9aff75b6-7eeb-4724-a999-73c60986a280" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.472284] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-9aff75b6-7eeb-4724-a999-73c60986a280" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.472425] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9aff75b6-7eeb-4724-a999-73c60986a280',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.568503] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.568678] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.568773] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.569309] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.569309] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.569536] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.569692] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.569764] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.570044] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.570153] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.570279] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40ac1d9f-7f09-4603-ba34-b3f5910e1da2 already deleted. [ 768.570398] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40ac1d9f-7f09-4603-ba34-b3f5910e1da2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.612740] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e in Status: SUCCESS [ 768.612845] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.613453] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.613453] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.613453] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.614629] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64557eb9-9b83-42ab-99e4-278f5711a22e in Status: SUCCESS [ 768.615210] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.615210] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.615210] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.615210] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64557eb9-9b83-42ab-99e4-278f5711a22e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.687127] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 706a5462-e893-428d-beb2-737cbec00439 in Status: SUCCESS [ 768.687272] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.688189] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.688189] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.688189] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.688189] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.688189] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.688189] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.688588] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.688588] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.688588] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.975165] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.975411] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.975552] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.975952] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.976168] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.976484] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 9aff75b6-7eeb-4724-a999-73c60986a280 not found, creating... [ 768.976813] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.977012] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.977144] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.977578] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.977578] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.977813] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.978438] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.978438] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.978438] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.978680] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.978680] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 9aff75b6-7eeb-4724-a999-73c60986a280 is going to be created. [ 768.998438] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.998645] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.998786] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.999057] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.999288] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.999523] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-9aff75b6-7eeb-4724-a999-73c60986a280" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.116829] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a27cb9c-bb13-44cb-a531-49610a94a36e taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.117178] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.117178] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.117328] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.117526] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.117630] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.117694] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.117867] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.117969] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.118075] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.118168] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.119195] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-64557eb9-9b83-42ab-99e4-278f5711a22e taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.119296] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.119385] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.119581] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.119753] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.119851] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.119914] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.120072] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.120152] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.120239] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.120322] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('64557eb9-9b83-42ab-99e4-278f5711a22e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.190769] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-706a5462-e893-428d-beb2-737cbec00439 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.190998] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.191090] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.191280] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.191459] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.191561] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.191630] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.191784] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.191854] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.191950] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.192140] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-706a5462-e893-428d-beb2-737cbec00439 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.192304] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.192402] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.192630] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.192867] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.192945] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.192977] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.193137] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.193236] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.193324] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.193417] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.622314] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a27cb9c-bb13-44cb-a531-49610a94a36e taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.622497] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.624088] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.624088] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.624088] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.624088] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.624088] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.624088] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.624088] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.624088] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.624088] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a27cb9c-bb13-44cb-a531-49610a94a36e taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.624088] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.624660] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.624660] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.624660] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.624660] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.624660] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.624885] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.624885] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.624885] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.625031] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.626695] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('64557eb9-9b83-42ab-99e4-278f5711a22e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.696169] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 706a5462-e893-428d-beb2-737cbec00439: rpc.has_security_group_logging(os_id): False [ 769.715039] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.720030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.720030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.720030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.720030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.720030] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.720030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.720030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.720030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.720030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.720030] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.720030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.720030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.720030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.720030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.720622] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.724131] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.724131] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.724131] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.724131] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.724131] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 706a5462-e893-428d-beb2-737cbec00439 is going to be updated. [ 769.803221] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.803524] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.803601] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.803868] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.803951] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.813863] env[69506]: INFO networking_nsxv3.common.synchronization [req-63a45b96-ac8f-4d88-8502-3418cd6a64ed req-45f185ff-d6d2-405a-a845-dc8bc950f974 service nova] Enqueued Resource ID: 40ac1d9f-7f09-4603-ba34-b3f5910e1da2 with Priority: HIGHEST for action security_group_rules [ 769.813863] env[69506]: INFO networking_nsxv3.common.synchronization [req-63a45b96-ac8f-4d88-8502-3418cd6a64ed req-45f185ff-d6d2-405a-a845-dc8bc950f974 service nova] Enqueued Resource ID: 40ac1d9f-7f09-4603-ba34-b3f5910e1da2 with Priority: HIGHEST for action security_group_members [ 769.813863] env[69506]: INFO networking_nsxv3.common.synchronization [req-63a45b96-ac8f-4d88-8502-3418cd6a64ed req-45f185ff-d6d2-405a-a845-dc8bc950f974 service nova] Enqueued Resource ID: 9aff75b6-7eeb-4724-a999-73c60986a280 with Priority: HIGHEST for action port [ 769.814254] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40ac1d9f-7f09-4603-ba34-b3f5910e1da2 with Priority: HIGHEST for action security_group_rules [ 769.814381] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40ac1d9f-7f09-4603-ba34-b3f5910e1da2 with Priority: HIGHEST for action security_group_members [ 769.814473] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9aff75b6-7eeb-4724-a999-73c60986a280 with Priority: HIGHEST for action port [ 769.814735] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40ac1d9f-7f09-4603-ba34-b3f5910e1da2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.814847] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40ac1d9f-7f09-4603-ba34-b3f5910e1da2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.814940] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40ac1d9f-7f09-4603-ba34-b3f5910e1da2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.815500] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40ac1d9f-7f09-4603-ba34-b3f5910e1da2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.815500] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40ac1d9f-7f09-4603-ba34-b3f5910e1da2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.816387] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-40ac1d9f-7f09-4603-ba34-b3f5910e1da2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.817206] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40ac1d9f-7f09-4603-ba34-b3f5910e1da2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.817270] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40ac1d9f-7f09-4603-ba34-b3f5910e1da2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.818498] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40ac1d9f-7f09-4603-ba34-b3f5910e1da2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.818498] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.818498] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.818498] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.818498] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.818498] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.818498] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40ac1d9f-7f09-4603-ba34-b3f5910e1da2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.818838] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-9aff75b6-7eeb-4724-a999-73c60986a280 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.819325] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9aff75b6-7eeb-4724-a999-73c60986a280" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.819325] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9aff75b6-7eeb-4724-a999-73c60986a280" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.819325] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9aff75b6-7eeb-4724-a999-73c60986a280" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.819325] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9aff75b6-7eeb-4724-a999-73c60986a280',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.903297] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 706a5462-e893-428d-beb2-737cbec00439 in Status: IN_PROGRESS for 2s [ 770.086680] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 in Status: SUCCESS [ 770.086962] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.087213] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.087443] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.087634] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.087787] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.087856] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.088036] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.088110] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.088203] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74c7c33d-c19d-4ab6-af56-0941c2240118',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.107729] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f130eeb-c453-4570-b0fe-743f47890102 in Status: SUCCESS [ 770.107944] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f130eeb-c453-4570-b0fe-743f47890102" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.108126] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f130eeb-c453-4570-b0fe-743f47890102" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.108356] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f130eeb-c453-4570-b0fe-743f47890102" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.108547] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.108673] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.108741] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.108949] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.108949] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.109048] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f130eeb-c453-4570-b0fe-743f47890102" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.109128] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f130eeb-c453-4570-b0fe-743f47890102',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.127979] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a27cb9c-bb13-44cb-a531-49610a94a36e: rpc.has_security_group_logging(os_id): False [ 770.129723] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 64557eb9-9b83-42ab-99e4-278f5711a22e: rpc.has_security_group_logging(os_id): False [ 770.155518] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.155683] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.155755] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.155983] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.156093] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.156349] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.156456] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.156522] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.156683] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.156761] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.156848] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64557eb9-9b83-42ab-99e4-278f5711a22e is going to be updated. [ 770.158511] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.158696] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.158696] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.158852] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.158945] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.159126] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.159223] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.159287] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.159541] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.159719] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.159953] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.160074] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.160156] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.160318] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.160414] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.160672] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.160822] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.160916] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.161123] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.161230] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.161356] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e is going to be updated. [ 770.249956] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.250184] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.250517] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.251229] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.251428] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.253838] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.253963] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.254049] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.254254] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.254397] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.267150] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64557eb9-9b83-42ab-99e4-278f5711a22e in Status: IN_PROGRESS for 2s [ 770.268779] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e in Status: IN_PROGRESS for 2s [ 770.322740] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-40ac1d9f-7f09-4603-ba34-b3f5910e1da2 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.322865] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40ac1d9f-7f09-4603-ba34-b3f5910e1da2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.323080] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40ac1d9f-7f09-4603-ba34-b3f5910e1da2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.323994] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9aff75b6-7eeb-4724-a999-73c60986a280 with status ACTIVE [ 770.328019] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.328019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.328019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.328019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.328019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.328019] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.328019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.328019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.328019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.328019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.328019] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.328019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.328019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.328019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.328019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.328019] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9aff75b6-7eeb-4724-a999-73c60986a280 is going to be updated. [ 770.353766] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5387ebf9-b56f-4308-969a-3aa715cad9da in Status: SUCCESS [ 770.353984] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5387ebf9-b56f-4308-969a-3aa715cad9da deletion is rescheduled due to dependency. [ 770.354119] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5387ebf9-b56f-4308-969a-3aa715cad9da" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.372510] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.372715] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.372782] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.372985] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.373127] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.373286] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9aff75b6-7eeb-4724-a999-73c60986a280" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.589859] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('74c7c33d-c19d-4ab6-af56-0941c2240118',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.611033] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f130eeb-c453-4570-b0fe-743f47890102',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.831490] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40ac1d9f-7f09-4603-ba34-b3f5910e1da2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.093447] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('74c7c33d-c19d-4ab6-af56-0941c2240118',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.115483] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f130eeb-c453-4570-b0fe-743f47890102: rpc.has_security_group_logging(os_id): False [ 771.136370] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.136796] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.136796] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.138954] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.139085] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.139407] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.139531] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.139566] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.139754] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.139831] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.139955] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f130eeb-c453-4570-b0fe-743f47890102 is going to be created. [ 771.213831] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.214035] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.214095] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.214329] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.215428] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.228500] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f130eeb-c453-4570-b0fe-743f47890102 in Status: IN_PROGRESS for 2s [ 771.333746] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.333917] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.334024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.334222] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.334325] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.334432] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40ac1d9f-7f09-4603-ba34-b3f5910e1da2 is going to be created. [ 771.367845] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.368091] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.368244] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.368686] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.368857] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.388850] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40ac1d9f-7f09-4603-ba34-b3f5910e1da2 in Status: UNINITIALIZED for 2s [ 771.595090] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.598018] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.598018] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.598018] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.598018] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.598018] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 is going to be updated. [ 771.651966] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.652195] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.652195] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.652373] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.652538] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.669644] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 in Status: IN_PROGRESS for 2s [ 771.918509] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 706a5462-e893-428d-beb2-737cbec00439 in Status: SUCCESS [ 771.918810] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.105153] env[69506]: INFO networking_nsxv3.common.synchronization [req-2d896ad5-339d-40d1-86dc-f683b82f5297 req-6b501494-63b5-4a4f-a058-b6b568d3ec66 tempest-AttachInterfacesUnderV243Test-153413102 tempest-AttachInterfacesUnderV243Test-153413102-project-member] Enqueued Resource ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 with Priority: HIGHEST for action security_group_members [ 772.106205] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 with Priority: HIGHEST for action security_group_members [ 772.106280] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-74c7c33d-c19d-4ab6-af56-0941c2240118 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.106503] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.129341] env[69506]: INFO networking_nsxv3.common.synchronization [req-2d896ad5-339d-40d1-86dc-f683b82f5297 req-6b501494-63b5-4a4f-a058-b6b568d3ec66 tempest-AttachInterfacesUnderV243Test-153413102 tempest-AttachInterfacesUnderV243Test-153413102-project-member] Enqueued Resource ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 with Priority: HIGHEST for action security_group_rules [ 772.129684] env[69506]: INFO networking_nsxv3.common.synchronization [req-2d896ad5-339d-40d1-86dc-f683b82f5297 req-6b501494-63b5-4a4f-a058-b6b568d3ec66 tempest-AttachInterfacesUnderV243Test-153413102 tempest-AttachInterfacesUnderV243Test-153413102-project-member] Enqueued Resource ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 with Priority: HIGHEST for action security_group_members [ 772.129734] env[69506]: INFO networking_nsxv3.common.synchronization [req-2d896ad5-339d-40d1-86dc-f683b82f5297 req-6b501494-63b5-4a4f-a058-b6b568d3ec66 tempest-AttachInterfacesUnderV243Test-153413102 tempest-AttachInterfacesUnderV243Test-153413102-project-member] Enqueued Resource ID: d10a6ff2-e16a-473b-aaca-5898c5e09055 with Priority: HIGHEST for action port [ 772.133565] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 with Priority: HIGHEST for action security_group_rules [ 772.139526] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 with Priority: HIGHEST for action security_group_members [ 772.139526] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d10a6ff2-e16a-473b-aaca-5898c5e09055 with Priority: HIGHEST for action port [ 772.139526] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-74c7c33d-c19d-4ab6-af56-0941c2240118 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.139526] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.139526] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-74c7c33d-c19d-4ab6-af56-0941c2240118 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.139526] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.139526] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-d10a6ff2-e16a-473b-aaca-5898c5e09055 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.139526] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d10a6ff2-e16a-473b-aaca-5898c5e09055" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.139526] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d10a6ff2-e16a-473b-aaca-5898c5e09055" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.140223] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d10a6ff2-e16a-473b-aaca-5898c5e09055" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.140223] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d10a6ff2-e16a-473b-aaca-5898c5e09055',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.285045] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e in Status: SUCCESS [ 772.285290] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.286020] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64557eb9-9b83-42ab-99e4-278f5711a22e in Status: SUCCESS [ 772.286476] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.643944] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d10a6ff2-e16a-473b-aaca-5898c5e09055 with status ACTIVE [ 772.644203] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.644346] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.644424] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.644689] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.644788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.644974] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.645090] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.645148] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.645307] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.645379] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.645562] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.645657] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.645711] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.645847] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.645920] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.646016] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d10a6ff2-e16a-473b-aaca-5898c5e09055 is going to be updated. [ 772.670154] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.670418] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.670418] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.670613] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.670705] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.670866] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d10a6ff2-e16a-473b-aaca-5898c5e09055" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.241363] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f130eeb-c453-4570-b0fe-743f47890102 in Status: SUCCESS [ 773.241363] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f130eeb-c453-4570-b0fe-743f47890102" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.401216] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40ac1d9f-7f09-4603-ba34-b3f5910e1da2 in Status: SUCCESS [ 773.401216] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40ac1d9f-7f09-4603-ba34-b3f5910e1da2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.401216] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40ac1d9f-7f09-4603-ba34-b3f5910e1da2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.401216] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40ac1d9f-7f09-4603-ba34-b3f5910e1da2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.401216] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.401216] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.401216] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.401216] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.401216] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.401216] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40ac1d9f-7f09-4603-ba34-b3f5910e1da2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.401216] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40ac1d9f-7f09-4603-ba34-b3f5910e1da2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.680277] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 in Status: SUCCESS [ 773.680494] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.680611] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.680829] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.681071] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.681192] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.681300] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.681411] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.681494] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.681596] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.681699] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('74c7c33d-c19d-4ab6-af56-0941c2240118',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.683032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.683208] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.683364] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.683466] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.683533] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.683670] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.683745] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.683829] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74c7c33d-c19d-4ab6-af56-0941c2240118',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.906028] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-40ac1d9f-7f09-4603-ba34-b3f5910e1da2 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.906028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40ac1d9f-7f09-4603-ba34-b3f5910e1da2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.906028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40ac1d9f-7f09-4603-ba34-b3f5910e1da2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.906028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40ac1d9f-7f09-4603-ba34-b3f5910e1da2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.906028] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.906028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.906028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.906028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.906028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.906028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40ac1d9f-7f09-4603-ba34-b3f5910e1da2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.906028] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-40ac1d9f-7f09-4603-ba34-b3f5910e1da2 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.906028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40ac1d9f-7f09-4603-ba34-b3f5910e1da2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.906028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40ac1d9f-7f09-4603-ba34-b3f5910e1da2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.906028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40ac1d9f-7f09-4603-ba34-b3f5910e1da2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.906028] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.906028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.906623] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.906623] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.906623] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.906623] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40ac1d9f-7f09-4603-ba34-b3f5910e1da2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.906623] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40ac1d9f-7f09-4603-ba34-b3f5910e1da2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.186768] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('74c7c33d-c19d-4ab6-af56-0941c2240118',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.187614] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('74c7c33d-c19d-4ab6-af56-0941c2240118',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.408537] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40ac1d9f-7f09-4603-ba34-b3f5910e1da2: rpc.has_security_group_logging(os_id): False [ 774.428618] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.428618] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.428618] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.428823] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.428884] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.429117] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.429218] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.429281] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.429437] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.429514] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.429694] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.429794] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.429851] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.430147] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.431339] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.431595] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.431709] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.431776] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.431930] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.432026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.432119] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40ac1d9f-7f09-4603-ba34-b3f5910e1da2 is going to be created. [ 774.495306] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.495306] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.495306] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.495442] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.495576] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.508542] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40ac1d9f-7f09-4603-ba34-b3f5910e1da2 in Status: IN_PROGRESS for 2s [ 774.690434] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 74c7c33d-c19d-4ab6-af56-0941c2240118: rpc.has_security_group_logging(os_id): False [ 774.691830] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('74c7c33d-c19d-4ab6-af56-0941c2240118',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.710641] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.714016] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.714016] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.714016] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.714016] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.714016] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.714016] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.714016] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.714016] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.714016] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.714016] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 is going to be updated. [ 774.782565] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.782565] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.782565] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.782565] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.782958] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.798860] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 in Status: IN_PROGRESS for 2s [ 775.197190] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.197190] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.197190] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.197190] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.197190] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.197190] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 is going to be updated. [ 775.224472] env[69506]: INFO networking_nsxv3.common.synchronization [None req-4adf41e5-e6a3-4c1c-8031-7c1cac736347 None None] Enqueued Resource ID: 2b6a622f-836c-49d5-85f8-e7603c4fabf6 with Priority: HIGHEST for action port [ 775.225033] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b6a622f-836c-49d5-85f8-e7603c4fabf6 with Priority: HIGHEST for action port [ 775.225367] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b6a622f-836c-49d5-85f8-e7603c4fabf6 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.225489] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b6a622f-836c-49d5-85f8-e7603c4fabf6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.227039] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b6a622f-836c-49d5-85f8-e7603c4fabf6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.227039] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b6a622f-836c-49d5-85f8-e7603c4fabf6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.227039] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b6a622f-836c-49d5-85f8-e7603c4fabf6',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.228498] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.228613] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.228699] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.228891] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.229049] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.239208] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 in Status: IN_PROGRESS for 2s [ 775.729318] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2b6a622f-836c-49d5-85f8-e7603c4fabf6 [ 775.729318] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.729318] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.729318] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.729318] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.729318] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.729318] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2b6a622f-836c-49d5-85f8-e7603c4fabf6 already deleted. [ 775.729318] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b6a622f-836c-49d5-85f8-e7603c4fabf6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.441061] env[69506]: INFO networking_nsxv3.common.synchronization [None req-51d3182a-281a-475a-a8bd-3c83e0de8051 tempest-ServersTestManualDisk-744845154 tempest-ServersTestManualDisk-744845154-project-member] Enqueued Resource ID: 77834f91-37e7-4feb-86e1-583e68d3d852 with Priority: HIGHEST for action security_group_rules [ 776.441400] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77834f91-37e7-4feb-86e1-583e68d3d852 with Priority: HIGHEST for action security_group_rules [ 776.441703] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77834f91-37e7-4feb-86e1-583e68d3d852 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.441703] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.441703] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.442116] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.442116] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77834f91-37e7-4feb-86e1-583e68d3d852',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.524907] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40ac1d9f-7f09-4603-ba34-b3f5910e1da2 in Status: SUCCESS [ 776.525245] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40ac1d9f-7f09-4603-ba34-b3f5910e1da2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.552116] env[69506]: INFO networking_nsxv3.common.synchronization [None req-a8f87e81-a015-4d2a-881e-5e22777c5ba1 tempest-ServersTestManualDisk-744845154 tempest-ServersTestManualDisk-744845154-project-member] Enqueued Resource ID: 77834f91-37e7-4feb-86e1-583e68d3d852 with Priority: HIGHEST for action security_group_rules [ 776.553327] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77834f91-37e7-4feb-86e1-583e68d3d852 with Priority: HIGHEST for action security_group_rules [ 776.553327] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77834f91-37e7-4feb-86e1-583e68d3d852 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.553327] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.817418] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 in Status: SUCCESS [ 776.817418] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.817418] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.817418] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.817418] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('74c7c33d-c19d-4ab6-af56-0941c2240118',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.962634] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.962634] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.962634] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.962880] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.962880] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.962950] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77834f91-37e7-4feb-86e1-583e68d3d852 already deleted. [ 776.962983] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.963145] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.963294] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.963379] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77834f91-37e7-4feb-86e1-583e68d3d852',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.136156] env[69506]: INFO networking_nsxv3.common.synchronization [None req-0fffd5c5-af07-49b3-a850-2eeee935ff87 None None] Enqueued Resource ID: b7f17413-f9f4-421a-b79c-437e7c61434c with Priority: HIGHEST for action port [ 777.136466] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7f17413-f9f4-421a-b79c-437e7c61434c with Priority: HIGHEST for action port [ 777.138115] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7f17413-f9f4-421a-b79c-437e7c61434c taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.138281] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7f17413-f9f4-421a-b79c-437e7c61434c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.138346] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7f17413-f9f4-421a-b79c-437e7c61434c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.139187] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7f17413-f9f4-421a-b79c-437e7c61434c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.139285] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7f17413-f9f4-421a-b79c-437e7c61434c',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.250850] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 in Status: SUCCESS [ 777.250850] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.250850] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.250850] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.250850] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.250850] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.250850] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.250850] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.250850] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.250850] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74c7c33d-c19d-4ab6-af56-0941c2240118',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.319223] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-74c7c33d-c19d-4ab6-af56-0941c2240118 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.319223] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.488288] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.488288] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.488288] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.488288] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.488288] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.488288] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77834f91-37e7-4feb-86e1-583e68d3d852 already deleted. [ 777.488288] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.588119] env[69506]: INFO networking_nsxv3.common.synchronization [req-0301f89d-d988-4445-93a7-6358b38bbea3 req-f3119b27-d4ed-4c01-9395-45c91dadc775 tempest-AttachInterfacesUnderV243Test-153413102 tempest-AttachInterfacesUnderV243Test-153413102-project-member] Enqueued Resource ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 with Priority: HIGHEST for action security_group_members [ 777.592304] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 with Priority: HIGHEST for action security_group_members [ 777.592304] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-74c7c33d-c19d-4ab6-af56-0941c2240118 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.592304] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.644875] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b7f17413-f9f4-421a-b79c-437e7c61434c [ 777.645148] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.645287] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.645353] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.645579] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.645672] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.645767] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b7f17413-f9f4-421a-b79c-437e7c61434c already deleted. [ 777.645849] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7f17413-f9f4-421a-b79c-437e7c61434c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.753074] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('74c7c33d-c19d-4ab6-af56-0941c2240118',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.799798] env[69506]: INFO networking_nsxv3.common.synchronization [None req-bbcb3990-50e6-4f53-89ea-5b8d5aefd3fd None None] Enqueued Resource ID: e03acf19-5f2d-4aa2-83ac-67a3a4334906 with Priority: HIGHEST for action port [ 777.799855] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e03acf19-5f2d-4aa2-83ac-67a3a4334906 with Priority: HIGHEST for action port [ 777.800177] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-e03acf19-5f2d-4aa2-83ac-67a3a4334906 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.800870] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e03acf19-5f2d-4aa2-83ac-67a3a4334906" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.800870] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e03acf19-5f2d-4aa2-83ac-67a3a4334906" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.800870] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e03acf19-5f2d-4aa2-83ac-67a3a4334906" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.800870] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e03acf19-5f2d-4aa2-83ac-67a3a4334906',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.259107] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('74c7c33d-c19d-4ab6-af56-0941c2240118',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.306398] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e03acf19-5f2d-4aa2-83ac-67a3a4334906 [ 778.306656] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.306800] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.306872] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.307102] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.307193] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.307289] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e03acf19-5f2d-4aa2-83ac-67a3a4334906 already deleted. [ 778.307375] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e03acf19-5f2d-4aa2-83ac-67a3a4334906" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.761827] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.761978] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.762065] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.762283] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.762372] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.762467] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 is going to be updated. [ 778.810339] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.810488] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.810552] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.811353] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.811570] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.822764] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 in Status: IN_PROGRESS for 2s [ 778.828026] env[69506]: INFO networking_nsxv3.common.synchronization [None req-5ba5df39-beb4-400d-a7d4-dd06c2576fea tempest-ServerActionsTestJSON-78405165 tempest-ServerActionsTestJSON-78405165-project-member] Enqueued Resource ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 with Priority: HIGHEST for action security_group_rules [ 778.828026] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 with Priority: HIGHEST for action security_group_rules [ 778.828026] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.828026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.828686] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.828686] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.828686] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('96b2c90a-a7a0-4dcb-8212-5e459d8d4793',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.958715] env[69506]: INFO networking_nsxv3.common.synchronization [None req-60e38c9a-15cd-495e-be3b-b51aa2a02471 tempest-ServerActionsTestJSON-78405165 tempest-ServerActionsTestJSON-78405165-project-member] Enqueued Resource ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 with Priority: HIGHEST for action security_group_rules [ 778.960280] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 with Priority: HIGHEST for action security_group_rules [ 778.960440] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.960552] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.350530] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.350530] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.350530] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.350530] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.350530] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.350530] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 already deleted. [ 779.350530] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.351225] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.351474] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.351658] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('96b2c90a-a7a0-4dcb-8212-5e459d8d4793',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.603142] env[69506]: INFO networking_nsxv3.common.synchronization [req-f46970bb-3d47-49d7-85fb-f222f1786caf req-f4e3b6db-edd6-4510-8915-993e02dfb7b1 tempest-ImagesTestJSON-821230832 tempest-ImagesTestJSON-821230832-project-member] Enqueued Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_members [ 779.603694] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_members [ 779.603992] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0db323-2ed4-4f6a-a30a-405b16133cb2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.604123] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.604247] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.604425] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.605151] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.605287] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.605352] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.605515] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.605600] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.605695] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.873584] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.873735] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.873795] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.873995] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.874100] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.874197] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 already deleted. [ 779.874289] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.906118] env[69506]: INFO networking_nsxv3.common.synchronization [None req-1ab49170-79aa-4881-a4b7-61f202ec48c0 None None] Enqueued Resource ID: 8b401e87-461b-424d-811b-34c0e52821af with Priority: HIGHEST for action port [ 779.906605] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b401e87-461b-424d-811b-34c0e52821af with Priority: HIGHEST for action port [ 779.906896] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b401e87-461b-424d-811b-34c0e52821af taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.907441] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b401e87-461b-424d-811b-34c0e52821af" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.907573] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b401e87-461b-424d-811b-34c0e52821af" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.907998] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b401e87-461b-424d-811b-34c0e52821af" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.908101] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b401e87-461b-424d-811b-34c0e52821af',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.108112] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.108335] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.108475] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.108782] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.108922] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.109206] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.109319] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.109453] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.109631] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.109730] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.109860] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 is going to be updated. [ 780.145227] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.145391] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.145448] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.145671] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.145871] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.157324] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: IN_PROGRESS for 2s [ 780.277676] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-612 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.277676] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-612" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.277676] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-612" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.277952] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-612" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.278918] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.278918] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.278918] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.279213] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.279247] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.279858] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 780.279858] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 780.279858] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 780.280133] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 780.280184] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 780.281890] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 780.281890] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 780.301854] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 780.302114] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 780.302810] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 780.302810] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-612" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.303081] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-bb5a42b0-a613-4cbb-9bf1-9ccd7695ecea taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.303337] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-bb5a42b0-a613-4cbb-9bf1-9ccd7695ecea" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.303500] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-bb5a42b0-a613-4cbb-9bf1-9ccd7695ecea" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.303959] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-bb5a42b0-a613-4cbb-9bf1-9ccd7695ecea" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.304179] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb5a42b0-a613-4cbb-9bf1-9ccd7695ecea',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.410703] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8b401e87-461b-424d-811b-34c0e52821af [ 780.411076] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.411230] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.411300] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.411541] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.411734] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.411734] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8b401e87-461b-424d-811b-34c0e52821af already deleted. [ 780.411857] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b401e87-461b-424d-811b-34c0e52821af" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.809354] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.809607] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.809957] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.810899] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.810899] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.810899] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port bb5a42b0-a613-4cbb-9bf1-9ccd7695ecea not found, creating... [ 780.811307] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.811648] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.811984] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.813039] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.813039] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.813039] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.813553] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.813864] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.816124] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.816124] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.816124] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: bb5a42b0-a613-4cbb-9bf1-9ccd7695ecea is going to be created. [ 780.835705] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 in Status: SUCCESS [ 780.835705] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.835705] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.835705] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.835705] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.835705] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.835705] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.836226] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.836226] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.836226] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.836226] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('74c7c33d-c19d-4ab6-af56-0941c2240118',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.837148] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.837372] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.837592] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.837714] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.837822] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.838008] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.838112] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.838208] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74c7c33d-c19d-4ab6-af56-0941c2240118',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.847475] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.847475] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.847652] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.847821] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.848070] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.848299] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-bb5a42b0-a613-4cbb-9bf1-9ccd7695ecea" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.340670] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('74c7c33d-c19d-4ab6-af56-0941c2240118',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.341456] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.341563] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.342376] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.342376] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.342376] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.342376] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.342376] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.342376] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.342684] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.342684] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.342684] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 is going to be updated. [ 781.379566] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.379740] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.379814] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.380033] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.380171] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.396637] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 in Status: IN_PROGRESS for 2s [ 781.533958] env[69506]: INFO networking_nsxv3.common.synchronization [req-f46970bb-3d47-49d7-85fb-f222f1786caf req-022c110c-5f7a-4fd7-89e8-e6c4182b0795 service nova] Enqueued Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_rules [ 781.533958] env[69506]: INFO networking_nsxv3.common.synchronization [req-f46970bb-3d47-49d7-85fb-f222f1786caf req-022c110c-5f7a-4fd7-89e8-e6c4182b0795 service nova] Enqueued Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_members [ 781.533958] env[69506]: INFO networking_nsxv3.common.synchronization [req-f46970bb-3d47-49d7-85fb-f222f1786caf req-022c110c-5f7a-4fd7-89e8-e6c4182b0795 service nova] Enqueued Resource ID: bb5a42b0-a613-4cbb-9bf1-9ccd7695ecea with Priority: HIGHEST for action port [ 781.534336] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_rules [ 781.534558] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_members [ 781.534558] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb5a42b0-a613-4cbb-9bf1-9ccd7695ecea with Priority: HIGHEST for action port [ 781.535551] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d0db323-2ed4-4f6a-a30a-405b16133cb2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.535651] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.535651] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.535853] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.537368] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.537368] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0db323-2ed4-4f6a-a30a-405b16133cb2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.537368] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.537368] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb5a42b0-a613-4cbb-9bf1-9ccd7695ecea taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.537656] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb5a42b0-a613-4cbb-9bf1-9ccd7695ecea" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.537656] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb5a42b0-a613-4cbb-9bf1-9ccd7695ecea" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.537656] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb5a42b0-a613-4cbb-9bf1-9ccd7695ecea" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.538018] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb5a42b0-a613-4cbb-9bf1-9ccd7695ecea',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.802883] env[69506]: INFO networking_nsxv3.common.synchronization [req-99104302-b163-4234-ba02-29611e194983 req-0fceb774-a459-46ba-a508-d8517befa067 tempest-ServerGroupTestJSON-915350675 tempest-ServerGroupTestJSON-915350675-project-member] Enqueued Resource ID: 40ac1d9f-7f09-4603-ba34-b3f5910e1da2 with Priority: HIGHEST for action security_group_members [ 781.804235] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40ac1d9f-7f09-4603-ba34-b3f5910e1da2 with Priority: HIGHEST for action security_group_members [ 781.804235] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-40ac1d9f-7f09-4603-ba34-b3f5910e1da2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.804235] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40ac1d9f-7f09-4603-ba34-b3f5910e1da2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.804235] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40ac1d9f-7f09-4603-ba34-b3f5910e1da2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.804235] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40ac1d9f-7f09-4603-ba34-b3f5910e1da2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.804512] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.804512] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.804512] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.804673] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.804722] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.804821] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40ac1d9f-7f09-4603-ba34-b3f5910e1da2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.844971] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 74c7c33d-c19d-4ab6-af56-0941c2240118: rpc.has_security_group_logging(os_id): False [ 781.865880] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.865880] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.865880] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.865880] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.865880] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.865880] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.865880] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.865880] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.865880] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.865880] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.865880] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 is going to be updated. [ 781.922716] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.922885] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.922948] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.923190] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.923335] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.938641] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 in Status: IN_PROGRESS for 2s [ 782.043576] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0db323-2ed4-4f6a-a30a-405b16133cb2 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.043719] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.044195] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bb5a42b0-a613-4cbb-9bf1-9ccd7695ecea with status ACTIVE [ 782.044195] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.044195] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.044316] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.044465] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.044530] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.044690] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.044804] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.044925] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.044975] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.045046] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.045228] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.045561] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.045561] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.045561] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.045751] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.045751] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bb5a42b0-a613-4cbb-9bf1-9ccd7695ecea is going to be updated. [ 782.067293] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.067427] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.067495] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.067688] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.067815] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.067967] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb5a42b0-a613-4cbb-9bf1-9ccd7695ecea" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.166119] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: SUCCESS [ 782.166317] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 deletion is rescheduled due to dependency. [ 782.166408] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.166596] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.166809] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.166985] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.167111] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.167174] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.167328] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.167407] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.167540] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.309226] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.309446] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.309544] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.309806] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.309933] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.310186] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.310335] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.310412] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.310573] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.310879] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.310879] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40ac1d9f-7f09-4603-ba34-b3f5910e1da2 is going to be updated. [ 782.338785] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.338908] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.338966] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.339184] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.339321] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.348363] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40ac1d9f-7f09-4603-ba34-b3f5910e1da2 in Status: IN_PROGRESS for 2s [ 782.670615] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.796534] env[69506]: INFO networking_nsxv3.common.synchronization [req-5d45865a-8c08-448b-b40f-dff4ac4ed369 req-0ba9a3a9-6181-4677-a777-a2b43b97fa3b tempest-ServersWithSpecificFlavorTestJSON-989278643 tempest-ServersWithSpecificFlavorTestJSON-989278643-project-member] Enqueued Resource ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 with Priority: HIGHEST for action security_group_members [ 782.797074] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 with Priority: HIGHEST for action security_group_members [ 782.797379] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6908af9-f839-40b2-9ca2-1fd554ee1d78 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.797501] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.797558] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.797752] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.797899] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.797993] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.798121] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.798267] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.798351] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.798458] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6908af9-f839-40b2-9ca2-1fd554ee1d78',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.174047] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.303425] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.303425] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.303425] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.303425] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.303425] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.303425] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.303425] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.303425] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.303425] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.303425] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.303425] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 is going to be updated. [ 783.327088] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.327558] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.327558] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.327708] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.327927] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.336458] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 in Status: IN_PROGRESS for 2s [ 783.407089] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 in Status: SUCCESS [ 783.407265] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 deletion is rescheduled due to dependency. [ 783.407386] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.676995] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.677349] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.677349] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.677471] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.677554] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.677655] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 is going to be updated. [ 783.704421] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.704596] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.704717] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.704882] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.705031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.713236] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: IN_PROGRESS for 2s [ 783.951330] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 in Status: SUCCESS [ 783.951567] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.357806] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40ac1d9f-7f09-4603-ba34-b3f5910e1da2 in Status: SUCCESS [ 784.358041] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40ac1d9f-7f09-4603-ba34-b3f5910e1da2 deletion is rescheduled due to dependency. [ 784.358143] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40ac1d9f-7f09-4603-ba34-b3f5910e1da2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.351604] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 in Status: SUCCESS [ 785.351604] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 deletion is rescheduled due to dependency. [ 785.351604] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.722992] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: SUCCESS [ 785.723333] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.723586] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.723902] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.724231] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.724419] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.724537] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.724783] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.724927] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.725177] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.725345] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.228397] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0db323-2ed4-4f6a-a30a-405b16133cb2 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.228663] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.228772] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.229040] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.229278] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.229418] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.229490] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.229942] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.230046] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.230169] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.230392] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0db323-2ed4-4f6a-a30a-405b16133cb2 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.230524] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.230611] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.230775] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.230919] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.231038] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.231085] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.231220] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.231302] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.231387] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.231478] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.734438] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d0db323-2ed4-4f6a-a30a-405b16133cb2: rpc.has_security_group_logging(os_id): False [ 786.751390] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.751524] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.751600] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.751806] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.751901] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.752098] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.752199] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.752261] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.752415] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.752496] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.752704] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.752802] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.752864] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.753009] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.753089] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.753281] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.753405] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.753459] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.753556] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.753630] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.753712] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 is going to be updated. [ 786.821742] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.821898] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.822022] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.822236] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.822503] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.832915] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: IN_PROGRESS for 2s [ 787.551101] env[69506]: INFO networking_nsxv3.common.synchronization [None req-c3f44d9c-2957-46ff-ac15-a5fc5a581d25 None None] Enqueued Resource ID: cc7eac5f-6fe5-4f06-8180-35dda34ae6f2 with Priority: HIGHEST for action port [ 787.551371] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7eac5f-6fe5-4f06-8180-35dda34ae6f2 with Priority: HIGHEST for action port [ 787.551922] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc7eac5f-6fe5-4f06-8180-35dda34ae6f2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.552058] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc7eac5f-6fe5-4f06-8180-35dda34ae6f2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.552127] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc7eac5f-6fe5-4f06-8180-35dda34ae6f2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.552375] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc7eac5f-6fe5-4f06-8180-35dda34ae6f2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.552521] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc7eac5f-6fe5-4f06-8180-35dda34ae6f2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.054905] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cc7eac5f-6fe5-4f06-8180-35dda34ae6f2 [ 788.055300] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.059023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.059023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.059023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.059023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.059023] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cc7eac5f-6fe5-4f06-8180-35dda34ae6f2 already deleted. [ 788.059023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc7eac5f-6fe5-4f06-8180-35dda34ae6f2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.585223] env[69506]: INFO networking_nsxv3.common.synchronization [req-19707ed1-4bcd-4a08-a0ed-11fa3ccefd25 req-99afd6b9-e5d5-4f53-89e3-08b17e4eaaa5 tempest-ListServerFiltersTestJSON-2708404 tempest-ListServerFiltersTestJSON-2708404-project-member] Enqueued Resource ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d with Priority: HIGHEST for action security_group_members [ 788.586269] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d with Priority: HIGHEST for action security_group_members [ 788.586874] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-823c6679-501c-4ec2-9d9f-f49b7cc1205d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.586874] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.586874] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.587187] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.587795] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.587914] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.587982] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.588256] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.588256] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.588352] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('823c6679-501c-4ec2-9d9f-f49b7cc1205d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.845817] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: SUCCESS [ 788.846050] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.091622] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.091901] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.091901] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.091992] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.092099] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.092828] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.092828] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.092828] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.092828] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.092828] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.092828] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d is going to be updated. [ 789.121393] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.121576] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.121619] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.121798] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.121941] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.132546] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d in Status: IN_PROGRESS for 2s [ 790.042347] env[69506]: INFO networking_nsxv3.common.synchronization [None req-c87c7735-5184-4105-a4d2-8c82cad59a7a None None] Enqueued Resource ID: 49291af8-c4dd-4344-bbf3-3618b5229281 with Priority: HIGHEST for action port [ 790.042793] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49291af8-c4dd-4344-bbf3-3618b5229281 with Priority: HIGHEST for action port [ 790.043371] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-49291af8-c4dd-4344-bbf3-3618b5229281 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.043494] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49291af8-c4dd-4344-bbf3-3618b5229281" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.043583] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49291af8-c4dd-4344-bbf3-3618b5229281" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.043847] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49291af8-c4dd-4344-bbf3-3618b5229281" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.043940] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49291af8-c4dd-4344-bbf3-3618b5229281',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.545890] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 49291af8-c4dd-4344-bbf3-3618b5229281 [ 790.546269] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.546367] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.546415] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.546666] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.547354] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.547354] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:49291af8-c4dd-4344-bbf3-3618b5229281 already deleted. [ 790.547354] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49291af8-c4dd-4344-bbf3-3618b5229281" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.143114] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d in Status: SUCCESS [ 791.143303] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d deletion is rescheduled due to dependency. [ 791.143417] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.091711] env[69506]: INFO networking_nsxv3.common.synchronization [req-fbd6099e-9229-4595-bcda-d58d67c65d5c req-3ec52e39-6843-4f7c-9a7c-c1b6e92f037b tempest-AttachInterfacesTestJSON-2055467997 tempest-AttachInterfacesTestJSON-2055467997-project-member] Enqueued Resource ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 with Priority: HIGHEST for action security_group_members [ 793.091999] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 with Priority: HIGHEST for action security_group_members [ 793.092251] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f946d66-543a-40be-9347-81d7eb4f4e31 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.092394] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.092462] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.092832] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.092998] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.093121] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.093463] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.093463] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.093463] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.093557] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.356559] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-868 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.356744] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-868" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.356867] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-868" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.357174] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-868" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.357912] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.357912] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.357912] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.357912] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.358171] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.358265] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 793.358475] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 793.358475] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 793.358632] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 793.358748] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 793.358856] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 793.359014] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 793.385520] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 793.385815] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 793.385884] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 793.386017] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-868" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.386384] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-bb445d69-262a-4061-b458-1cadaa39561e taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.386592] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-bb445d69-262a-4061-b458-1cadaa39561e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.386733] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-bb445d69-262a-4061-b458-1cadaa39561e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.387105] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-bb445d69-262a-4061-b458-1cadaa39561e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.387299] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb445d69-262a-4061-b458-1cadaa39561e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.595475] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.595636] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.595711] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.595931] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.596041] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.596251] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.596353] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.596424] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.596584] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.596661] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.596909] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 already deleted. [ 793.596909] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.890203] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.890426] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.890554] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.890852] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.890976] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.891152] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port bb445d69-262a-4061-b458-1cadaa39561e not found, creating... [ 793.891410] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.891565] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.891682] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.891901] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.892055] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.892333] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.892487] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.892668] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.892889] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.893033] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.893172] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: bb445d69-262a-4061-b458-1cadaa39561e is going to be created. [ 793.912765] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.912977] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.913114] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.913360] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.913582] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.913805] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-bb445d69-262a-4061-b458-1cadaa39561e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.707502] env[69506]: INFO networking_nsxv3.common.synchronization [req-fbd6099e-9229-4595-bcda-d58d67c65d5c req-cc2c371c-d9e7-4916-b05c-19277823d18e service nova] Enqueued Resource ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 with Priority: HIGHEST for action security_group_rules [ 794.707729] env[69506]: INFO networking_nsxv3.common.synchronization [req-fbd6099e-9229-4595-bcda-d58d67c65d5c req-cc2c371c-d9e7-4916-b05c-19277823d18e service nova] Enqueued Resource ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 with Priority: HIGHEST for action security_group_members [ 794.707762] env[69506]: INFO networking_nsxv3.common.synchronization [req-fbd6099e-9229-4595-bcda-d58d67c65d5c req-cc2c371c-d9e7-4916-b05c-19277823d18e service nova] Enqueued Resource ID: bb445d69-262a-4061-b458-1cadaa39561e with Priority: HIGHEST for action port [ 794.707993] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 with Priority: HIGHEST for action security_group_rules [ 794.708140] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 with Priority: HIGHEST for action security_group_members [ 794.708403] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb445d69-262a-4061-b458-1cadaa39561e with Priority: HIGHEST for action port [ 794.708831] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f946d66-543a-40be-9347-81d7eb4f4e31 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.708964] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.709045] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.709342] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.709401] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.710699] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f946d66-543a-40be-9347-81d7eb4f4e31 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.710922] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.710922] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.711054] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.711184] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.711274] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.711336] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.711475] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.711567] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.711665] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.713026] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb445d69-262a-4061-b458-1cadaa39561e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.713026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb445d69-262a-4061-b458-1cadaa39561e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.713026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb445d69-262a-4061-b458-1cadaa39561e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.713026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb445d69-262a-4061-b458-1cadaa39561e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.713026] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb445d69-262a-4061-b458-1cadaa39561e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.214838] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f946d66-543a-40be-9347-81d7eb4f4e31 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.215202] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.215431] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.216741] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bb445d69-262a-4061-b458-1cadaa39561e with status ACTIVE [ 795.217136] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.217327] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.217327] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.217547] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.217640] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.217823] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.217989] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.217989] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.218183] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.218259] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.218500] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.218896] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.218896] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.218896] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.219242] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.219289] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bb445d69-262a-4061-b458-1cadaa39561e is going to be updated. [ 795.238086] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.238225] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.238304] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.238486] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.238618] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.238778] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb445d69-262a-4061-b458-1cadaa39561e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.721990] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.225118] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.225288] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.225370] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.225658] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.225829] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.225942] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 is going to be created. [ 796.270052] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.270052] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.270052] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.270052] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.270052] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.284174] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 in Status: UNINITIALIZED for 2s [ 797.159602] env[69506]: INFO networking_nsxv3.common.synchronization [req-949ec847-7cc9-4881-b0b6-65ff8398eb1f req-24b80257-8f7b-4489-ae4c-34720568b898 tempest-ServerDiskConfigTestJSON-583020681 tempest-ServerDiskConfigTestJSON-583020681-project-member] Enqueued Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_members [ 797.161025] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_members [ 797.161025] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-008501d4-938b-4336-9c1d-ef3665f7d09d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.161025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.161025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.161025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.161025] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.161517] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.161517] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.161517] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.161517] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.161677] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.482322] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-350 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.482702] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-350" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.483097] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-350" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.483345] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-350" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.483867] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.484073] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.484197] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.484428] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.484578] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.484794] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 797.484911] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 797.485039] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 797.485218] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 797.485359] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 797.485474] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 797.485611] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 797.521199] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 797.521387] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 797.521541] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 797.521730] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-350" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.522056] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-2ceb5fa5-1c99-4a7f-bdfb-8a533cc82cad taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.522232] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-2ceb5fa5-1c99-4a7f-bdfb-8a533cc82cad" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.522375] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-2ceb5fa5-1c99-4a7f-bdfb-8a533cc82cad" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.522708] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-2ceb5fa5-1c99-4a7f-bdfb-8a533cc82cad" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.522867] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ceb5fa5-1c99-4a7f-bdfb-8a533cc82cad',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.664405] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.664623] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.664712] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.664958] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.665079] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.665272] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.665396] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.665478] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.665669] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.666482] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.666482] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 008501d4-938b-4336-9c1d-ef3665f7d09d is going to be updated. [ 797.696273] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.696557] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.696772] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.697052] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.697166] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.705706] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 008501d4-938b-4336-9c1d-ef3665f7d09d in Status: IN_PROGRESS for 2s [ 798.025478] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.025713] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.025844] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.026157] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.026312] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.026471] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 2ceb5fa5-1c99-4a7f-bdfb-8a533cc82cad not found, creating... [ 798.026734] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.026894] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.027090] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.027279] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.027419] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.028026] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.028133] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.028184] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.028392] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.028526] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.028698] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 2ceb5fa5-1c99-4a7f-bdfb-8a533cc82cad is going to be created. [ 798.052281] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.052481] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.052608] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.052865] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.053096] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.053313] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-2ceb5fa5-1c99-4a7f-bdfb-8a533cc82cad" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.295445] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 in Status: SUCCESS [ 798.295845] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.295990] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.296227] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.296422] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.296553] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.296598] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.296763] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.296850] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.296937] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.297091] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.742557] env[69506]: INFO networking_nsxv3.common.synchronization [req-949ec847-7cc9-4881-b0b6-65ff8398eb1f req-0339cf4e-4fe7-45c3-ac30-9df4bf64b350 service nova] Enqueued Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_rules [ 798.742759] env[69506]: INFO networking_nsxv3.common.synchronization [req-949ec847-7cc9-4881-b0b6-65ff8398eb1f req-0339cf4e-4fe7-45c3-ac30-9df4bf64b350 service nova] Enqueued Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_members [ 798.742912] env[69506]: INFO networking_nsxv3.common.synchronization [req-949ec847-7cc9-4881-b0b6-65ff8398eb1f req-0339cf4e-4fe7-45c3-ac30-9df4bf64b350 service nova] Enqueued Resource ID: 2ceb5fa5-1c99-4a7f-bdfb-8a533cc82cad with Priority: HIGHEST for action port [ 798.743184] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_rules [ 798.743328] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_members [ 798.743420] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ceb5fa5-1c99-4a7f-bdfb-8a533cc82cad with Priority: HIGHEST for action port [ 798.744016] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-008501d4-938b-4336-9c1d-ef3665f7d09d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.745094] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.747637] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.747637] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.747637] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.749216] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-008501d4-938b-4336-9c1d-ef3665f7d09d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.750202] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.750202] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ceb5fa5-1c99-4a7f-bdfb-8a533cc82cad taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.750397] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ceb5fa5-1c99-4a7f-bdfb-8a533cc82cad" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.750397] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ceb5fa5-1c99-4a7f-bdfb-8a533cc82cad" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.750584] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ceb5fa5-1c99-4a7f-bdfb-8a533cc82cad" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.750661] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ceb5fa5-1c99-4a7f-bdfb-8a533cc82cad',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.800146] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f946d66-543a-40be-9347-81d7eb4f4e31 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.800325] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.800394] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.800623] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.800800] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.800913] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.800974] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.801149] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.801237] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.801327] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.801474] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f946d66-543a-40be-9347-81d7eb4f4e31 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.801564] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.801625] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.801763] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.801897] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.801985] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.802057] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.802192] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.802267] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.802348] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.802435] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.249910] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-008501d4-938b-4336-9c1d-ef3665f7d09d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.249910] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.254487] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2ceb5fa5-1c99-4a7f-bdfb-8a533cc82cad with status ACTIVE [ 799.254745] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.254902] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.255299] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.255299] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.255299] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.255473] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.255543] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.255591] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.255784] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.255923] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.256031] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.256141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.256141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.256276] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.256345] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.256425] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2ceb5fa5-1c99-4a7f-bdfb-8a533cc82cad is going to be updated. [ 799.278618] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.278834] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.278876] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.279079] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.279225] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.279426] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ceb5fa5-1c99-4a7f-bdfb-8a533cc82cad" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.305013] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3f946d66-543a-40be-9347-81d7eb4f4e31: rpc.has_security_group_logging(os_id): False [ 799.336440] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.336626] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.336699] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.336916] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.337016] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.337223] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.337318] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.337476] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.337532] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.337602] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.337799] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.337894] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.337946] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.338103] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.338175] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.338361] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.338461] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.338518] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.338780] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.338864] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.338973] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 is going to be created. [ 799.467512] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.467512] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.467512] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.467512] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.467512] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.489428] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 in Status: IN_PROGRESS for 2s [ 799.715166] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 008501d4-938b-4336-9c1d-ef3665f7d09d in Status: SUCCESS [ 799.715357] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 008501d4-938b-4336-9c1d-ef3665f7d09d deletion is rescheduled due to dependency. [ 799.715459] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.715646] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.715888] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.716139] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.716286] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.716370] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.716550] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.716655] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.716760] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.027565] env[69506]: INFO networking_nsxv3.common.synchronization [req-054213c4-7052-46ae-b874-49bbea077f9c req-f7c7f797-2497-4806-af3d-77138e1eb88a tempest-ServerTagsTestJSON-157450972 tempest-ServerTagsTestJSON-157450972-project-member] Enqueued Resource ID: d1fc353c-0404-4f16-bed0-42c4e9a557a3 with Priority: HIGHEST for action security_group_members [ 800.028133] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1fc353c-0404-4f16-bed0-42c4e9a557a3 with Priority: HIGHEST for action security_group_members [ 800.028447] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1fc353c-0404-4f16-bed0-42c4e9a557a3 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.028773] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1fc353c-0404-4f16-bed0-42c4e9a557a3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.029046] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1fc353c-0404-4f16-bed0-42c4e9a557a3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.029222] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1fc353c-0404-4f16-bed0-42c4e9a557a3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.029404] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.029508] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.029591] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.029758] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.029843] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.029941] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1fc353c-0404-4f16-bed0-42c4e9a557a3',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.224526] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.491431] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-928 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.492736] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-928" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.492736] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-928" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.492736] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-928" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.492736] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.492736] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.492736] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.492736] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.493137] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.493137] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 800.493137] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 800.493222] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 800.493334] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 800.493443] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 800.493547] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 800.493685] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 800.511977] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 800.512133] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 800.512279] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 800.512481] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-928" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.512857] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-2cc3b897-e4ba-41be-815a-0d30496f8753 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.513088] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-2cc3b897-e4ba-41be-815a-0d30496f8753" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.513230] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-2cc3b897-e4ba-41be-815a-0d30496f8753" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.513795] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-2cc3b897-e4ba-41be-815a-0d30496f8753" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.513795] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cc3b897-e4ba-41be-815a-0d30496f8753',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.535978] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.535978] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.535978] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.535978] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.535978] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.535978] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.535978] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.535978] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.535978] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.535978] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.535978] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1fc353c-0404-4f16-bed0-42c4e9a557a3 already deleted. [ 800.535978] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1fc353c-0404-4f16-bed0-42c4e9a557a3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.730107] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.018512] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.018803] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.018905] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.019219] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.019369] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.019526] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 2cc3b897-e4ba-41be-815a-0d30496f8753 not found, creating... [ 801.019791] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.019952] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.020085] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.020304] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.020446] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.020729] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.020890] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.021015] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.021230] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.021366] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.021507] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 2cc3b897-e4ba-41be-815a-0d30496f8753 is going to be created. [ 801.046031] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.046031] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.046031] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.046031] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.046031] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.046369] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-2cc3b897-e4ba-41be-815a-0d30496f8753" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.232587] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.232738] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.232784] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.233000] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.233105] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.233204] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 008501d4-938b-4336-9c1d-ef3665f7d09d is going to be updated. [ 801.269291] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.269479] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.269556] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.269695] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.269879] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.282935] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 008501d4-938b-4336-9c1d-ef3665f7d09d in Status: IN_PROGRESS for 2s [ 801.502982] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 in Status: SUCCESS [ 801.503630] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.958227] env[69506]: INFO networking_nsxv3.common.synchronization [req-054213c4-7052-46ae-b874-49bbea077f9c req-880a7300-6641-42af-a580-5ae8e8ed7299 service nova] Enqueued Resource ID: d1fc353c-0404-4f16-bed0-42c4e9a557a3 with Priority: HIGHEST for action security_group_rules [ 801.958227] env[69506]: INFO networking_nsxv3.common.synchronization [req-054213c4-7052-46ae-b874-49bbea077f9c req-880a7300-6641-42af-a580-5ae8e8ed7299 service nova] Enqueued Resource ID: d1fc353c-0404-4f16-bed0-42c4e9a557a3 with Priority: HIGHEST for action security_group_members [ 801.958315] env[69506]: INFO networking_nsxv3.common.synchronization [req-054213c4-7052-46ae-b874-49bbea077f9c req-880a7300-6641-42af-a580-5ae8e8ed7299 service nova] Enqueued Resource ID: 2cc3b897-e4ba-41be-815a-0d30496f8753 with Priority: HIGHEST for action port [ 801.958905] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1fc353c-0404-4f16-bed0-42c4e9a557a3 with Priority: HIGHEST for action security_group_rules [ 801.959079] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1fc353c-0404-4f16-bed0-42c4e9a557a3 with Priority: HIGHEST for action security_group_members [ 801.959199] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cc3b897-e4ba-41be-815a-0d30496f8753 with Priority: HIGHEST for action port [ 801.959521] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1fc353c-0404-4f16-bed0-42c4e9a557a3 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.959654] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1fc353c-0404-4f16-bed0-42c4e9a557a3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.959723] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1fc353c-0404-4f16-bed0-42c4e9a557a3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.959986] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1fc353c-0404-4f16-bed0-42c4e9a557a3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.960081] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1fc353c-0404-4f16-bed0-42c4e9a557a3',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.961073] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1fc353c-0404-4f16-bed0-42c4e9a557a3 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.961639] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1fc353c-0404-4f16-bed0-42c4e9a557a3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.961799] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1fc353c-0404-4f16-bed0-42c4e9a557a3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.962023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1fc353c-0404-4f16-bed0-42c4e9a557a3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.962214] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.962341] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.962409] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.962601] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.962707] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.962805] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1fc353c-0404-4f16-bed0-42c4e9a557a3',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.964064] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-2cc3b897-e4ba-41be-815a-0d30496f8753 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.964064] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2cc3b897-e4ba-41be-815a-0d30496f8753" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.964064] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2cc3b897-e4ba-41be-815a-0d30496f8753" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.964064] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2cc3b897-e4ba-41be-815a-0d30496f8753" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.964254] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cc3b897-e4ba-41be-815a-0d30496f8753',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.477503] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d1fc353c-0404-4f16-bed0-42c4e9a557a3',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.478620] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1fc353c-0404-4f16-bed0-42c4e9a557a3 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.478756] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1fc353c-0404-4f16-bed0-42c4e9a557a3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.478907] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2cc3b897-e4ba-41be-815a-0d30496f8753 with status ACTIVE [ 802.479078] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.479182] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.479263] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.482373] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.482373] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.482373] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.482373] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.482373] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.482373] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.482373] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.482373] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.482373] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.482373] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.482373] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.482373] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.482373] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2cc3b897-e4ba-41be-815a-0d30496f8753 is going to be updated. [ 802.502030] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.502183] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.502257] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.502467] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.502604] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.502765] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2cc3b897-e4ba-41be-815a-0d30496f8753" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.578544] env[69506]: INFO networking_nsxv3.common.synchronization [req-1c2bc382-e10a-4edd-be86-eb76f2f3028c req-ddfaf5d1-7b4e-4804-91e7-d7c0dc154072 tempest-MigrationsAdminTest-625008670 tempest-MigrationsAdminTest-625008670-project-member] Enqueued Resource ID: 0745f36a-3469-4c49-9c0f-8111fe1bd802 with Priority: HIGHEST for action security_group_members [ 802.579239] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0745f36a-3469-4c49-9c0f-8111fe1bd802 with Priority: HIGHEST for action security_group_members [ 802.579556] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0745f36a-3469-4c49-9c0f-8111fe1bd802 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.579691] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.579764] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.580063] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.580174] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.580260] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.580338] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.580520] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.580613] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.580711] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0745f36a-3469-4c49-9c0f-8111fe1bd802',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.983617] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d1fc353c-0404-4f16-bed0-42c4e9a557a3',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.082826] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0745f36a-3469-4c49-9c0f-8111fe1bd802',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.268190] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-438 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.268190] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.268190] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.268190] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.268473] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.269045] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.269045] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.269195] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.269276] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.269948] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 803.269948] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 803.269948] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 803.270103] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 803.270192] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 803.270352] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 803.270542] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 803.289965] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 803.290198] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 803.290365] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 803.290554] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.290982] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-fe2a6467-4cf9-434a-b71d-7dc39f0afc9c taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.291134] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-fe2a6467-4cf9-434a-b71d-7dc39f0afc9c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.291255] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-fe2a6467-4cf9-434a-b71d-7dc39f0afc9c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.291609] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-fe2a6467-4cf9-434a-b71d-7dc39f0afc9c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.291757] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe2a6467-4cf9-434a-b71d-7dc39f0afc9c',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.294121] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 008501d4-938b-4336-9c1d-ef3665f7d09d in Status: SUCCESS [ 803.294318] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.294689] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.294908] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.295110] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.295308] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.295308] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.295444] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.295529] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.295615] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.295708] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.486062] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.486241] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.486317] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.486589] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.486698] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.486800] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1fc353c-0404-4f16-bed0-42c4e9a557a3 is going to be created. [ 803.510762] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.510996] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.510996] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.511211] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.511373] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.520567] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1fc353c-0404-4f16-bed0-42c4e9a557a3 in Status: UNINITIALIZED for 2s [ 803.586493] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0745f36a-3469-4c49-9c0f-8111fe1bd802',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.796096] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.796393] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.796540] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.796861] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.797117] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.797398] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port fe2a6467-4cf9-434a-b71d-7dc39f0afc9c not found, creating... [ 803.797776] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.798089] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.798262] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.798641] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.798849] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.799316] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.799550] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.799811] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.800147] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.800401] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.800659] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: fe2a6467-4cf9-434a-b71d-7dc39f0afc9c is going to be created. [ 803.802325] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-008501d4-938b-4336-9c1d-ef3665f7d09d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.802471] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.802602] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.802849] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.803084] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.803273] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.803387] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.803577] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.803713] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.803839] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.804116] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-008501d4-938b-4336-9c1d-ef3665f7d09d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.804270] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.804368] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.804569] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.804812] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.804980] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.805113] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.805376] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.805439] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.805565] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.805736] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.824480] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.824760] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.824892] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.825233] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.825486] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.825775] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-fe2a6467-4cf9-434a-b71d-7dc39f0afc9c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.089999] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.090253] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.090253] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.090439] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.090546] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.090663] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0745f36a-3469-4c49-9c0f-8111fe1bd802 is going to be updated. [ 804.118441] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.118664] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.118725] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.118963] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.119140] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.127653] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0745f36a-3469-4c49-9c0f-8111fe1bd802 in Status: IN_PROGRESS for 2s [ 804.308856] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 008501d4-938b-4336-9c1d-ef3665f7d09d: rpc.has_security_group_logging(os_id): False [ 804.326222] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.326409] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.326503] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.326699] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.326782] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.327010] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.327148] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.327224] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.327364] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.327444] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.327640] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.327767] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.327862] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.328020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.328100] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.328284] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.328378] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.328474] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.328578] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.328704] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.328859] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 008501d4-938b-4336-9c1d-ef3665f7d09d is going to be updated. [ 804.390527] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.390783] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.390962] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.391803] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.392045] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.405384] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 008501d4-938b-4336-9c1d-ef3665f7d09d in Status: IN_PROGRESS for 2s [ 804.853823] env[69506]: INFO networking_nsxv3.common.synchronization [req-1c2bc382-e10a-4edd-be86-eb76f2f3028c req-a02e068e-cfa1-43ec-a86e-268b5ac3793a service nova] Enqueued Resource ID: 0745f36a-3469-4c49-9c0f-8111fe1bd802 with Priority: HIGHEST for action security_group_rules [ 804.854098] env[69506]: INFO networking_nsxv3.common.synchronization [req-1c2bc382-e10a-4edd-be86-eb76f2f3028c req-a02e068e-cfa1-43ec-a86e-268b5ac3793a service nova] Enqueued Resource ID: 0745f36a-3469-4c49-9c0f-8111fe1bd802 with Priority: HIGHEST for action security_group_members [ 804.854245] env[69506]: INFO networking_nsxv3.common.synchronization [req-1c2bc382-e10a-4edd-be86-eb76f2f3028c req-a02e068e-cfa1-43ec-a86e-268b5ac3793a service nova] Enqueued Resource ID: fe2a6467-4cf9-434a-b71d-7dc39f0afc9c with Priority: HIGHEST for action port [ 804.854758] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0745f36a-3469-4c49-9c0f-8111fe1bd802 with Priority: HIGHEST for action security_group_rules [ 804.854906] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0745f36a-3469-4c49-9c0f-8111fe1bd802 with Priority: HIGHEST for action security_group_members [ 804.855040] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe2a6467-4cf9-434a-b71d-7dc39f0afc9c with Priority: HIGHEST for action port [ 804.855347] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0745f36a-3469-4c49-9c0f-8111fe1bd802 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.855484] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.855575] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.855808] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.855904] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0745f36a-3469-4c49-9c0f-8111fe1bd802',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.856820] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0745f36a-3469-4c49-9c0f-8111fe1bd802 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.856944] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.857178] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe2a6467-4cf9-434a-b71d-7dc39f0afc9c taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.857291] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe2a6467-4cf9-434a-b71d-7dc39f0afc9c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.857358] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe2a6467-4cf9-434a-b71d-7dc39f0afc9c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.857556] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe2a6467-4cf9-434a-b71d-7dc39f0afc9c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.857661] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe2a6467-4cf9-434a-b71d-7dc39f0afc9c',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.361026] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0745f36a-3469-4c49-9c0f-8111fe1bd802 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.361026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.361026] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fe2a6467-4cf9-434a-b71d-7dc39f0afc9c with status ACTIVE [ 805.361253] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.361253] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.361335] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.363636] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.363636] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.363636] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.363636] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.363636] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.363636] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.363636] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.363636] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.363636] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.363636] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.363636] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.363636] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.363636] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fe2a6467-4cf9-434a-b71d-7dc39f0afc9c is going to be updated. [ 805.385935] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.385935] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.385935] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.385935] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.385935] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.385935] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe2a6467-4cf9-434a-b71d-7dc39f0afc9c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.488092] env[69506]: INFO networking_nsxv3.common.synchronization [req-f296503b-da9d-4d0e-89e8-a757d6ef50fe req-64edd669-3422-4266-8b50-b85a35ab42e2 tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_members [ 805.488648] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_members [ 805.488959] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a27cb9c-bb13-44cb-a531-49610a94a36e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.489115] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.489226] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.489661] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.490697] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.490697] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.490697] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.490853] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.491120] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.491222] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.532480] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1fc353c-0404-4f16-bed0-42c4e9a557a3 in Status: SUCCESS [ 805.532695] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1fc353c-0404-4f16-bed0-42c4e9a557a3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.532865] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1fc353c-0404-4f16-bed0-42c4e9a557a3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.533184] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1fc353c-0404-4f16-bed0-42c4e9a557a3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.533289] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.533845] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.533845] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.533845] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.533845] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.533845] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1fc353c-0404-4f16-bed0-42c4e9a557a3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.533845] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d1fc353c-0404-4f16-bed0-42c4e9a557a3',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.993665] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.040023] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1fc353c-0404-4f16-bed0-42c4e9a557a3 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.040023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1fc353c-0404-4f16-bed0-42c4e9a557a3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.040023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1fc353c-0404-4f16-bed0-42c4e9a557a3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.040023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1fc353c-0404-4f16-bed0-42c4e9a557a3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.040023] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.040023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.040023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.040023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.040420] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.040420] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1fc353c-0404-4f16-bed0-42c4e9a557a3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.040420] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1fc353c-0404-4f16-bed0-42c4e9a557a3 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.040524] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1fc353c-0404-4f16-bed0-42c4e9a557a3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.040553] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1fc353c-0404-4f16-bed0-42c4e9a557a3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.040740] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1fc353c-0404-4f16-bed0-42c4e9a557a3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.040911] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.041026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.041114] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.041275] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.041363] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.041460] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1fc353c-0404-4f16-bed0-42c4e9a557a3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.041549] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d1fc353c-0404-4f16-bed0-42c4e9a557a3',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.139094] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0745f36a-3469-4c49-9c0f-8111fe1bd802 in Status: SUCCESS [ 806.139094] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.139094] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.139094] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.139094] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.139094] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.139094] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.139094] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.139094] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.139094] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0745f36a-3469-4c49-9c0f-8111fe1bd802',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.418508] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 008501d4-938b-4336-9c1d-ef3665f7d09d in Status: SUCCESS [ 806.418755] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.496284] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.544282] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d1fc353c-0404-4f16-bed0-42c4e9a557a3: rpc.has_security_group_logging(os_id): False [ 806.573044] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.573260] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.573325] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.573544] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.573638] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.573840] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.573936] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.573998] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.574161] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.574253] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.574471] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.574522] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.575537] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.575537] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.575537] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.575537] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.575537] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.575537] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.575537] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.576193] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.576193] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1fc353c-0404-4f16-bed0-42c4e9a557a3 is going to be created. [ 806.587571] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-828 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.587759] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-828" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.587884] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-828" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.589115] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-828" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.589115] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.589115] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.589115] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.589115] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.589115] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.589401] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 806.589517] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 806.589595] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 806.589701] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 806.589811] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 806.589919] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 806.590066] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 806.616182] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 806.616182] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 806.616182] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 806.616182] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-828" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.616443] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-fa8149fe-ca30-4921-8ef2-8835531a6595 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.616627] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-fa8149fe-ca30-4921-8ef2-8835531a6595" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.616743] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-fa8149fe-ca30-4921-8ef2-8835531a6595" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.617292] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-fa8149fe-ca30-4921-8ef2-8835531a6595" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.617292] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa8149fe-ca30-4921-8ef2-8835531a6595',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.643628] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0745f36a-3469-4c49-9c0f-8111fe1bd802',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.669836] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.669836] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.669836] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.669836] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.671039] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.687136] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1fc353c-0404-4f16-bed0-42c4e9a557a3 in Status: IN_PROGRESS for 2s [ 807.006204] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.006204] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.006204] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.006204] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.006204] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.006204] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e is going to be updated. [ 807.028819] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.028819] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.028819] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.028819] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.028819] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.039190] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e in Status: IN_PROGRESS for 2s [ 807.127410] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.127410] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.129576] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.129576] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.129576] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.129576] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port fa8149fe-ca30-4921-8ef2-8835531a6595 not found, creating... [ 807.129576] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.129576] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.129576] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.129576] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.129576] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.129576] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.130113] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.130113] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.130113] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.130206] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.130341] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: fa8149fe-ca30-4921-8ef2-8835531a6595 is going to be created. [ 807.144071] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0745f36a-3469-4c49-9c0f-8111fe1bd802',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.161245] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.161463] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.161645] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.161982] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.162311] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.162583] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-fa8149fe-ca30-4921-8ef2-8835531a6595" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.254412] env[69506]: INFO networking_nsxv3.common.synchronization [req-5c23378f-a9f1-48d1-88e9-c6a632d3d61c req-4d11909e-4667-4002-8420-62942d390f14 tempest-VolumesAssistedSnapshotsTest-664082795 tempest-VolumesAssistedSnapshotsTest-664082795-project-member] Enqueued Resource ID: 66b9350a-2732-4479-ad5a-cb47a49072f7 with Priority: HIGHEST for action security_group_members [ 807.257051] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66b9350a-2732-4479-ad5a-cb47a49072f7 with Priority: HIGHEST for action security_group_members [ 807.257471] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-66b9350a-2732-4479-ad5a-cb47a49072f7 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.258190] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66b9350a-2732-4479-ad5a-cb47a49072f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.258376] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66b9350a-2732-4479-ad5a-cb47a49072f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.258678] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66b9350a-2732-4479-ad5a-cb47a49072f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.258948] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.259173] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.259315] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.259547] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.259756] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.260106] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66b9350a-2732-4479-ad5a-cb47a49072f7',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.653115] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.653389] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.656101] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.656101] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.656101] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.656101] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0745f36a-3469-4c49-9c0f-8111fe1bd802 is going to be updated. [ 807.685398] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.685581] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.685702] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.685833] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.688344] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.697354] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0745f36a-3469-4c49-9c0f-8111fe1bd802 in Status: IN_PROGRESS for 2s [ 807.767795] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.767795] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.767795] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.767795] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.767795] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.767795] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.767795] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.767795] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.767795] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.767795] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.767795] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66b9350a-2732-4479-ad5a-cb47a49072f7 is going to be updated. [ 807.791251] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.791496] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.791496] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.791659] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.791793] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.802219] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66b9350a-2732-4479-ad5a-cb47a49072f7 in Status: IN_PROGRESS for 2s [ 808.178754] env[69506]: INFO networking_nsxv3.common.synchronization [req-f296503b-da9d-4d0e-89e8-a757d6ef50fe req-15b7f573-94a7-4289-8a54-867ef5089c32 service nova] Enqueued Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_rules [ 808.179064] env[69506]: INFO networking_nsxv3.common.synchronization [req-f296503b-da9d-4d0e-89e8-a757d6ef50fe req-15b7f573-94a7-4289-8a54-867ef5089c32 service nova] Enqueued Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_members [ 808.179136] env[69506]: INFO networking_nsxv3.common.synchronization [req-f296503b-da9d-4d0e-89e8-a757d6ef50fe req-15b7f573-94a7-4289-8a54-867ef5089c32 service nova] Enqueued Resource ID: fa8149fe-ca30-4921-8ef2-8835531a6595 with Priority: HIGHEST for action port [ 808.180039] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_rules [ 808.180039] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_members [ 808.180039] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa8149fe-ca30-4921-8ef2-8835531a6595 with Priority: HIGHEST for action port [ 808.180505] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a27cb9c-bb13-44cb-a531-49610a94a36e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.180667] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.180765] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.180999] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.181526] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.183336] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a27cb9c-bb13-44cb-a531-49610a94a36e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.183336] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.184106] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa8149fe-ca30-4921-8ef2-8835531a6595 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.184209] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa8149fe-ca30-4921-8ef2-8835531a6595" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.184810] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa8149fe-ca30-4921-8ef2-8835531a6595" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.184810] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa8149fe-ca30-4921-8ef2-8835531a6595" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.184810] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa8149fe-ca30-4921-8ef2-8835531a6595',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.417556] env[69506]: INFO networking_nsxv3.common.synchronization [req-f379f62a-e453-463f-8c64-88abf786fff3 req-0e94d7dc-0218-4351-ac36-e543ff74f53e tempest-ServersAdminNegativeTestJSON-1868968513 tempest-ServersAdminNegativeTestJSON-1868968513-project-member] Enqueued Resource ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 with Priority: HIGHEST for action security_group_members [ 808.417816] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 with Priority: HIGHEST for action security_group_members [ 808.418131] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-78caaaf6-868f-4043-93dd-d9a75a05d023 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.418247] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.418311] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.418515] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.418678] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.418780] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.418840] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.418990] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.423330] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.423479] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78caaaf6-868f-4043-93dd-d9a75a05d023',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.687031] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a27cb9c-bb13-44cb-a531-49610a94a36e taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.687031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.687714] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fa8149fe-ca30-4921-8ef2-8835531a6595 with status ACTIVE [ 808.688388] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.688514] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.688655] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.689218] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.689218] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.689218] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.689218] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.691179] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.691179] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.691179] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.691179] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.691179] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.691179] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.691179] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.691179] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.691179] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fa8149fe-ca30-4921-8ef2-8835531a6595 is going to be updated. [ 808.705130] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1fc353c-0404-4f16-bed0-42c4e9a557a3 in Status: SUCCESS [ 808.705411] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1fc353c-0404-4f16-bed0-42c4e9a557a3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.714603] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.714773] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.714828] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.714997] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.715140] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.715292] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa8149fe-ca30-4921-8ef2-8835531a6595" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.926550] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78caaaf6-868f-4043-93dd-d9a75a05d023',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.046664] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e in Status: SUCCESS [ 809.046783] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.046943] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.047178] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.047363] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.047480] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.047544] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.047708] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.047819] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.047952] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.434685] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78caaaf6-868f-4043-93dd-d9a75a05d023',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.556484] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.587222] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-438 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.589447] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.589447] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.589447] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.594021] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.594021] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.594021] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.594021] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.594021] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.594021] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 809.594021] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 809.594021] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 809.594021] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 809.594021] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 809.594021] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 809.594021] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 809.614044] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 809.614044] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 809.614702] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 809.614741] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.615223] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-c3fdc259-1e56-4c15-808f-6de9d3459c7a taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.615515] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-c3fdc259-1e56-4c15-808f-6de9d3459c7a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.615691] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-c3fdc259-1e56-4c15-808f-6de9d3459c7a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.621278] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-c3fdc259-1e56-4c15-808f-6de9d3459c7a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.621278] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3fdc259-1e56-4c15-808f-6de9d3459c7a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.708874] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0745f36a-3469-4c49-9c0f-8111fe1bd802 in Status: SUCCESS [ 809.708874] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.708874] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.708874] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.708874] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.708874] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.708874] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.708874] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.708874] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.708874] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.708874] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0745f36a-3469-4c49-9c0f-8111fe1bd802',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.812367] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66b9350a-2732-4479-ad5a-cb47a49072f7 in Status: SUCCESS [ 809.813251] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66b9350a-2732-4479-ad5a-cb47a49072f7 deletion is rescheduled due to dependency. [ 809.813251] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66b9350a-2732-4479-ad5a-cb47a49072f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.936702] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.937199] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.937199] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.937199] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.937318] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.937366] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 is going to be updated. [ 809.965440] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.967976] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.967976] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.967976] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.967976] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.976099] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 in Status: IN_PROGRESS for 2s [ 810.058322] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.126972] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.127211] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.127432] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.127674] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.127829] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.127983] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port c3fdc259-1e56-4c15-808f-6de9d3459c7a not found, creating... [ 810.129544] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.129544] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.129544] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.129544] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.129544] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.129544] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.129544] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.129957] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.129993] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.130812] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.131122] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: c3fdc259-1e56-4c15-808f-6de9d3459c7a is going to be created. [ 810.156037] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.156037] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.156037] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.156424] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.156465] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.156701] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-c3fdc259-1e56-4c15-808f-6de9d3459c7a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.212869] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0745f36a-3469-4c49-9c0f-8111fe1bd802 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.212869] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.212869] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.212869] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.212869] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.212869] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.212869] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.212869] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.212869] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.212869] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.213282] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0745f36a-3469-4c49-9c0f-8111fe1bd802 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.213282] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.213282] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.213389] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.213448] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.213539] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.213615] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.213751] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.213828] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.213912] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.214017] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0745f36a-3469-4c49-9c0f-8111fe1bd802',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.476126] env[69506]: INFO networking_nsxv3.common.synchronization [req-90de6912-4dd0-4383-bc7a-6380d8687530 req-cccaf3f9-e750-4c67-8abb-ae97eb60aeba tempest-AttachInterfacesTestJSON-2055467997 tempest-AttachInterfacesTestJSON-2055467997-project-member] Enqueued Resource ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 with Priority: HIGHEST for action security_group_members [ 810.476693] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 with Priority: HIGHEST for action security_group_members [ 810.477045] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f946d66-543a-40be-9347-81d7eb4f4e31 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.477133] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.477195] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.477390] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.477570] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.477647] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.477697] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.477828] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.477984] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.477984] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.562038] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.562038] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.562038] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.562232] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.562808] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.562808] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e is going to be updated. [ 810.592469] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.592646] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.592791] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.593167] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.593167] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.601985] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e in Status: IN_PROGRESS for 2s [ 810.716217] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0745f36a-3469-4c49-9c0f-8111fe1bd802: rpc.has_security_group_logging(os_id): False [ 810.735557] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.735755] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.735842] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.736111] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.736208] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.736472] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.736580] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.736695] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.736807] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.736891] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.737080] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.737182] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.737491] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.737631] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.737705] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.737887] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.737984] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.738059] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.738198] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.738272] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.738359] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0745f36a-3469-4c49-9c0f-8111fe1bd802 is going to be updated. [ 810.794580] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.794744] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.794819] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.795148] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.795249] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.806648] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0745f36a-3469-4c49-9c0f-8111fe1bd802 in Status: IN_PROGRESS for 2s [ 810.983185] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.983185] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.983372] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.983631] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.983794] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.983961] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.984079] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.984185] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.984292] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.984372] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.984461] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 is going to be updated. [ 811.015211] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.015482] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.015547] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.016203] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.016203] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.026486] env[69506]: INFO networking_nsxv3.common.synchronization [req-4edbf730-d2c9-4129-9c55-65ab75b12d78 req-63486147-8256-4ef4-866b-afa233b39875 tempest-ImagesTestJSON-821230832 tempest-ImagesTestJSON-821230832-project-member] Enqueued Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_members [ 811.027471] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 in Status: IN_PROGRESS for 2s [ 811.027831] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_members [ 811.029025] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0db323-2ed4-4f6a-a30a-405b16133cb2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.029025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.029025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.029025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.029025] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.029025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.029025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.029330] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.029330] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.029330] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.105631] env[69506]: INFO networking_nsxv3.common.synchronization [req-dc3586db-8bb2-4818-aa32-dc61065429c3 req-beb55153-f05b-4eaf-b725-2be6d5da86d7 tempest-ImagesOneServerTestJSON-1625652254 tempest-ImagesOneServerTestJSON-1625652254-project-member] Enqueued Resource ID: 05c6d62a-58f1-418b-815e-8b3f7f5cd5eb with Priority: HIGHEST for action security_group_members [ 811.108833] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05c6d62a-58f1-418b-815e-8b3f7f5cd5eb with Priority: HIGHEST for action security_group_members [ 811.108833] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.108833] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.108833] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.108833] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.108833] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.108833] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.108833] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.108833] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.108833] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.108833] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05c6d62a-58f1-418b-815e-8b3f7f5cd5eb',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.381488] env[69506]: INFO networking_nsxv3.common.synchronization [req-f379f62a-e453-463f-8c64-88abf786fff3 req-1666e610-9676-4384-bd4b-d9e7c45b85ea service nova] Enqueued Resource ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 with Priority: HIGHEST for action security_group_rules [ 811.381885] env[69506]: INFO networking_nsxv3.common.synchronization [req-f379f62a-e453-463f-8c64-88abf786fff3 req-1666e610-9676-4384-bd4b-d9e7c45b85ea service nova] Enqueued Resource ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 with Priority: HIGHEST for action security_group_members [ 811.382146] env[69506]: INFO networking_nsxv3.common.synchronization [req-f379f62a-e453-463f-8c64-88abf786fff3 req-1666e610-9676-4384-bd4b-d9e7c45b85ea service nova] Enqueued Resource ID: c3fdc259-1e56-4c15-808f-6de9d3459c7a with Priority: HIGHEST for action port [ 811.387311] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 with Priority: HIGHEST for action security_group_rules [ 811.387311] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 with Priority: HIGHEST for action security_group_members [ 811.387311] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3fdc259-1e56-4c15-808f-6de9d3459c7a with Priority: HIGHEST for action port [ 811.387311] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78caaaf6-868f-4043-93dd-d9a75a05d023 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.387311] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.387311] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.387311] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.387311] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78caaaf6-868f-4043-93dd-d9a75a05d023',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.387311] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-78caaaf6-868f-4043-93dd-d9a75a05d023 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.387311] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.387311] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3fdc259-1e56-4c15-808f-6de9d3459c7a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.387311] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3fdc259-1e56-4c15-808f-6de9d3459c7a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.387311] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3fdc259-1e56-4c15-808f-6de9d3459c7a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.388314] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3fdc259-1e56-4c15-808f-6de9d3459c7a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.388314] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3fdc259-1e56-4c15-808f-6de9d3459c7a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.531582] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.531928] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.531928] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.532048] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.532175] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.532387] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.532490] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.532555] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.532730] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.532814] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.532928] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 is going to be updated. [ 811.571615] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.571805] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.571880] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.572206] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.572371] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.582140] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: IN_PROGRESS for 2s [ 811.615084] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.615084] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.615084] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.615084] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.615084] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.615084] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.615084] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.615084] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.615084] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.615084] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.615084] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05c6d62a-58f1-418b-815e-8b3f7f5cd5eb already deleted. [ 811.615084] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.892327] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-78caaaf6-868f-4043-93dd-d9a75a05d023 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.892479] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.892687] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3fdc259-1e56-4c15-808f-6de9d3459c7a with status ACTIVE [ 811.892864] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.892974] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.893049] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.893267] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.893355] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.893526] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.893624] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.893678] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.893859] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.893945] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.894149] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.894244] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.894305] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.894446] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.894522] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.894609] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3fdc259-1e56-4c15-808f-6de9d3459c7a is going to be updated. [ 811.917834] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.918020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.918194] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.918323] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.918466] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.918669] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3fdc259-1e56-4c15-808f-6de9d3459c7a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.992038] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 in Status: SUCCESS [ 811.992038] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.992038] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.992038] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.992038] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.992038] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.992038] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.992038] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.992038] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.992038] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78caaaf6-868f-4043-93dd-d9a75a05d023',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.318219] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-442 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.318416] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-442" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.318854] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-442" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.318953] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-442" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.319486] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.319486] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.319654] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.321677] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.321677] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.323514] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 812.323675] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 812.323811] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 812.323929] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 812.324064] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 812.324175] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 812.324348] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 812.345204] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 812.345453] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 812.345631] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 812.345823] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-442" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.346148] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-6e84c47a-b064-4361-aa88-3f8cae865665 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.346324] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-6e84c47a-b064-4361-aa88-3f8cae865665" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.346445] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-6e84c47a-b064-4361-aa88-3f8cae865665" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.346772] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-6e84c47a-b064-4361-aa88-3f8cae865665" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.346950] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e84c47a-b064-4361-aa88-3f8cae865665',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.494098] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78caaaf6-868f-4043-93dd-d9a75a05d023',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.611743] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e in Status: SUCCESS [ 812.611999] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.612152] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.612393] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.612612] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.612736] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.612804] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.612959] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.613059] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.613188] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.613339] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.818392] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0745f36a-3469-4c49-9c0f-8111fe1bd802 in Status: SUCCESS [ 812.819142] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.852227] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.852540] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.852855] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.853213] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.853404] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.853592] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 6e84c47a-b064-4361-aa88-3f8cae865665 not found, creating... [ 812.853890] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.854118] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.854323] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.854611] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.854813] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.856249] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.856249] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.856249] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.856249] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.856249] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.856641] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 6e84c47a-b064-4361-aa88-3f8cae865665 is going to be created. [ 812.874940] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.874940] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.874940] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.875262] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.875504] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.875732] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-6e84c47a-b064-4361-aa88-3f8cae865665" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.996151] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78caaaf6-868f-4043-93dd-d9a75a05d023',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.037350] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 in Status: SUCCESS [ 813.037561] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 deletion is rescheduled due to dependency. [ 813.037691] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.124220] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a27cb9c-bb13-44cb-a531-49610a94a36e taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.124220] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.124220] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.124220] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.124220] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.124220] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.124220] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.124220] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.124220] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.124220] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.124220] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a27cb9c-bb13-44cb-a531-49610a94a36e taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.124220] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.124220] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.124220] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.124220] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.124220] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.124798] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.124798] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.124798] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.124798] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.124798] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.498983] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.499162] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.499210] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.499391] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.499482] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.499594] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 is going to be updated. [ 813.525513] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.525669] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.525716] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.525918] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.526074] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.534298] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 in Status: IN_PROGRESS for 2s [ 813.554175] env[69506]: INFO networking_nsxv3.common.synchronization [None req-b42aff55-e365-4ed0-844c-cbb3e96f45a3 None None] Enqueued Resource ID: 73fc6b9e-0257-4d69-82b6-fcf011b93c05 with Priority: HIGHEST for action port [ 813.554840] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73fc6b9e-0257-4d69-82b6-fcf011b93c05 with Priority: HIGHEST for action port [ 813.555023] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-73fc6b9e-0257-4d69-82b6-fcf011b93c05 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.555156] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73fc6b9e-0257-4d69-82b6-fcf011b93c05" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.555223] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73fc6b9e-0257-4d69-82b6-fcf011b93c05" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.555482] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73fc6b9e-0257-4d69-82b6-fcf011b93c05" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.555573] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73fc6b9e-0257-4d69-82b6-fcf011b93c05',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.591089] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: SUCCESS [ 813.591342] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 deletion is rescheduled due to dependency. [ 813.591383] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.626885] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a27cb9c-bb13-44cb-a531-49610a94a36e: rpc.has_security_group_logging(os_id): False [ 813.648064] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.648064] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.648064] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.648064] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.648064] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.648064] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.648064] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.648064] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.648064] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.648064] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.648064] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.648064] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.648064] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.648064] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.649677] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.649677] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.649677] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.649677] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.649677] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.649677] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.649677] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e is going to be updated. [ 813.652491] env[69506]: INFO networking_nsxv3.common.synchronization [req-13039d5e-ddc8-4f84-bca3-fa5fd1deef49 req-c2bc8433-66e2-4100-ae73-16363e7777ff tempest-ServersAdminTestJSON-446545879 tempest-ServersAdminTestJSON-446545879-project-member] Enqueued Resource ID: 706a5462-e893-428d-beb2-737cbec00439 with Priority: HIGHEST for action security_group_members [ 813.652983] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 706a5462-e893-428d-beb2-737cbec00439 with Priority: HIGHEST for action security_group_members [ 813.653319] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-706a5462-e893-428d-beb2-737cbec00439 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.653424] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.653523] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.653804] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.653990] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.654134] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.654216] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.654409] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.654604] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.654604] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.718046] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.718342] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.718342] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.718547] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.718669] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.735716] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e in Status: IN_PROGRESS for 2s [ 813.894302] env[69506]: INFO networking_nsxv3.common.synchronization [req-dc3586db-8bb2-4818-aa32-dc61065429c3 req-f2e10e58-f7e6-4845-bb46-6f47c1a5676d service nova] Enqueued Resource ID: 05c6d62a-58f1-418b-815e-8b3f7f5cd5eb with Priority: HIGHEST for action security_group_rules [ 813.894302] env[69506]: INFO networking_nsxv3.common.synchronization [req-dc3586db-8bb2-4818-aa32-dc61065429c3 req-f2e10e58-f7e6-4845-bb46-6f47c1a5676d service nova] Enqueued Resource ID: 05c6d62a-58f1-418b-815e-8b3f7f5cd5eb with Priority: HIGHEST for action security_group_members [ 813.894302] env[69506]: INFO networking_nsxv3.common.synchronization [req-dc3586db-8bb2-4818-aa32-dc61065429c3 req-f2e10e58-f7e6-4845-bb46-6f47c1a5676d service nova] Enqueued Resource ID: 6e84c47a-b064-4361-aa88-3f8cae865665 with Priority: HIGHEST for action port [ 813.894302] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05c6d62a-58f1-418b-815e-8b3f7f5cd5eb with Priority: HIGHEST for action security_group_rules [ 813.894302] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05c6d62a-58f1-418b-815e-8b3f7f5cd5eb with Priority: HIGHEST for action security_group_members [ 813.894302] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e84c47a-b064-4361-aa88-3f8cae865665 with Priority: HIGHEST for action port [ 813.898174] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.901286] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.901286] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.901286] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.901286] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05c6d62a-58f1-418b-815e-8b3f7f5cd5eb',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.901286] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.901286] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.901286] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.901286] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.905137] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.905137] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.905137] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.905137] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.905137] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.905401] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05c6d62a-58f1-418b-815e-8b3f7f5cd5eb',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.906168] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e84c47a-b064-4361-aa88-3f8cae865665 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.906297] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e84c47a-b064-4361-aa88-3f8cae865665" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.906338] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e84c47a-b064-4361-aa88-3f8cae865665" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.907067] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e84c47a-b064-4361-aa88-3f8cae865665" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.907067] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e84c47a-b064-4361-aa88-3f8cae865665',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.058805] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 73fc6b9e-0257-4d69-82b6-fcf011b93c05 [ 814.059072] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.059900] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.059900] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.059900] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.059900] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.059900] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:73fc6b9e-0257-4d69-82b6-fcf011b93c05 already deleted. [ 814.059900] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73fc6b9e-0257-4d69-82b6-fcf011b93c05" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.158547] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.408892] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.409080] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.409280] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('05c6d62a-58f1-418b-815e-8b3f7f5cd5eb',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.411144] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6e84c47a-b064-4361-aa88-3f8cae865665 with status ACTIVE [ 814.411144] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.411144] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.411144] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.411144] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.411144] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.411617] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.411804] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.411888] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.412088] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.412174] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.412386] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.412485] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.412544] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.412694] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.413267] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.413267] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6e84c47a-b064-4361-aa88-3f8cae865665 is going to be updated. [ 814.434962] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.434962] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.434962] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.434962] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.434962] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.434962] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e84c47a-b064-4361-aa88-3f8cae865665" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.448385] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-149 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.448385] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-149" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.448385] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-149" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.448385] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-149" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.448385] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.448385] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.448385] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.448385] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.448385] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.448385] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 814.448385] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 814.448385] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 814.448385] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 814.449801] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 814.450087] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 814.450351] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 814.471188] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 814.471188] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 814.471967] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 814.473282] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-149" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.473282] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-c4d3e596-4840-4b47-933b-2c64c2e80253 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.473282] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-c4d3e596-4840-4b47-933b-2c64c2e80253" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.473282] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-c4d3e596-4840-4b47-933b-2c64c2e80253" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.473282] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-c4d3e596-4840-4b47-933b-2c64c2e80253" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.474780] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4d3e596-4840-4b47-933b-2c64c2e80253',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.662647] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.669483] env[69506]: INFO networking_nsxv3.common.synchronization [req-4ba19905-1b9e-4574-a547-b63cb58e79f7 req-e0bf1d6f-9fee-47fc-9eff-fa1c2ef1614a tempest-AttachInterfacesTestJSON-2055467997 tempest-AttachInterfacesTestJSON-2055467997-project-member] Enqueued Resource ID: 56702d6b-7f85-46e1-bf9f-c5bba683fb41 with Priority: HIGHEST for action security_group_members [ 814.670486] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56702d6b-7f85-46e1-bf9f-c5bba683fb41 with Priority: HIGHEST for action security_group_members [ 814.673264] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-56702d6b-7f85-46e1-bf9f-c5bba683fb41 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.673264] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56702d6b-7f85-46e1-bf9f-c5bba683fb41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.673264] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56702d6b-7f85-46e1-bf9f-c5bba683fb41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.673264] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56702d6b-7f85-46e1-bf9f-c5bba683fb41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.673264] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.673264] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.673264] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.673590] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.673590] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.673646] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56702d6b-7f85-46e1-bf9f-c5bba683fb41',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.914904] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('05c6d62a-58f1-418b-815e-8b3f7f5cd5eb',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.979542] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.980688] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.980865] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.981468] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.981671] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.982582] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port c4d3e596-4840-4b47-933b-2c64c2e80253 not found, creating... [ 814.982701] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.982968] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.983157] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.983762] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.983762] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.984020] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.984244] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.984409] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.984715] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.984894] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.985090] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: c4d3e596-4840-4b47-933b-2c64c2e80253 is going to be created. [ 815.006149] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.006600] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.006600] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.006809] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.007047] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.007402] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-c4d3e596-4840-4b47-933b-2c64c2e80253" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.168866] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.169061] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.169148] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.169327] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.169418] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.169518] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 706a5462-e893-428d-beb2-737cbec00439 is going to be updated. [ 815.176557] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.176777] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.176777] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.176963] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.177071] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.177286] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.177389] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.177439] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.177592] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.177754] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.177754] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56702d6b-7f85-46e1-bf9f-c5bba683fb41 is going to be updated. [ 815.217866] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.217866] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.217866] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.217866] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.217866] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.219356] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.219744] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.220086] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.220400] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.220655] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.227808] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 706a5462-e893-428d-beb2-737cbec00439 in Status: IN_PROGRESS for 2s [ 815.228573] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56702d6b-7f85-46e1-bf9f-c5bba683fb41 in Status: IN_PROGRESS for 2s [ 815.418318] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.418754] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.418954] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.419281] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.419525] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.419825] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05c6d62a-58f1-418b-815e-8b3f7f5cd5eb is going to be created. [ 815.444091] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.444091] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.444091] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.444091] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.444091] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.451726] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05c6d62a-58f1-418b-815e-8b3f7f5cd5eb in Status: UNINITIALIZED for 2s [ 815.549730] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 in Status: SUCCESS [ 815.550067] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.550067] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.551902] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.551902] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.551902] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.551902] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.551902] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.551902] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.551902] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.551902] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78caaaf6-868f-4043-93dd-d9a75a05d023',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.753176] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e in Status: SUCCESS [ 815.753455] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.916400] env[69506]: INFO networking_nsxv3.common.synchronization [None req-98a4270f-d4d1-40ef-9b1e-1e6d26b9ac7f None None] Enqueued Resource ID: eaf8c4d1-a3ff-491f-950b-1b34dcfefc4d with Priority: HIGHEST for action port [ 815.916400] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaf8c4d1-a3ff-491f-950b-1b34dcfefc4d with Priority: HIGHEST for action port [ 815.917020] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-eaf8c4d1-a3ff-491f-950b-1b34dcfefc4d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.917168] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eaf8c4d1-a3ff-491f-950b-1b34dcfefc4d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.917226] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eaf8c4d1-a3ff-491f-950b-1b34dcfefc4d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.917561] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eaf8c4d1-a3ff-491f-950b-1b34dcfefc4d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.917561] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eaf8c4d1-a3ff-491f-950b-1b34dcfefc4d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.054977] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-78caaaf6-868f-4043-93dd-d9a75a05d023 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.055209] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.055288] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.055514] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.055694] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.055798] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.055856] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.056023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.056344] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.056344] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.056415] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-78caaaf6-868f-4043-93dd-d9a75a05d023 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.056546] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.056660] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.056938] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.057287] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.057287] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.057287] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.057392] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.057392] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.057579] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.057965] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78caaaf6-868f-4043-93dd-d9a75a05d023',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.083639] env[69506]: INFO networking_nsxv3.common.synchronization [req-13039d5e-ddc8-4f84-bca3-fa5fd1deef49 req-269ff249-0749-4993-bf8f-5654ee4b8195 service nova] Enqueued Resource ID: 706a5462-e893-428d-beb2-737cbec00439 with Priority: HIGHEST for action security_group_rules [ 816.083965] env[69506]: INFO networking_nsxv3.common.synchronization [req-13039d5e-ddc8-4f84-bca3-fa5fd1deef49 req-269ff249-0749-4993-bf8f-5654ee4b8195 service nova] Enqueued Resource ID: 706a5462-e893-428d-beb2-737cbec00439 with Priority: HIGHEST for action security_group_members [ 816.083965] env[69506]: INFO networking_nsxv3.common.synchronization [req-13039d5e-ddc8-4f84-bca3-fa5fd1deef49 req-269ff249-0749-4993-bf8f-5654ee4b8195 service nova] Enqueued Resource ID: c4d3e596-4840-4b47-933b-2c64c2e80253 with Priority: HIGHEST for action port [ 816.085460] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 706a5462-e893-428d-beb2-737cbec00439 with Priority: HIGHEST for action security_group_rules [ 816.085460] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 706a5462-e893-428d-beb2-737cbec00439 with Priority: HIGHEST for action security_group_members [ 816.085610] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4d3e596-4840-4b47-933b-2c64c2e80253 with Priority: HIGHEST for action port [ 816.085939] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-706a5462-e893-428d-beb2-737cbec00439 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.086156] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.086667] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.086667] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.086667] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.088337] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-706a5462-e893-428d-beb2-737cbec00439 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.088337] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.088337] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4d3e596-4840-4b47-933b-2c64c2e80253 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.089329] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4d3e596-4840-4b47-933b-2c64c2e80253" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.089422] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4d3e596-4840-4b47-933b-2c64c2e80253" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.089620] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4d3e596-4840-4b47-933b-2c64c2e80253" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.089724] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4d3e596-4840-4b47-933b-2c64c2e80253',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.426060] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eaf8c4d1-a3ff-491f-950b-1b34dcfefc4d [ 816.427154] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.427154] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.427154] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.427154] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.427154] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.427154] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eaf8c4d1-a3ff-491f-950b-1b34dcfefc4d already deleted. [ 816.427154] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eaf8c4d1-a3ff-491f-950b-1b34dcfefc4d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.564056] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78caaaf6-868f-4043-93dd-d9a75a05d023: rpc.has_security_group_logging(os_id): False [ 816.582100] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.582282] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.582357] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.582570] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.582691] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.582910] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.583034] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.583098] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.583257] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.583336] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.583561] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.583657] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.583721] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.583859] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.583933] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.585531] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.585715] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.585828] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.586025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.586160] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.586415] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 is going to be updated. [ 816.592357] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-706a5462-e893-428d-beb2-737cbec00439 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.592471] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.592628] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c4d3e596-4840-4b47-933b-2c64c2e80253 with status ACTIVE [ 816.592783] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.592923] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.592991] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.593202] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.593297] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.593464] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.593575] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.593633] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.593786] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.593867] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.594054] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.594165] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.594222] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.594352] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.594437] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.594523] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c4d3e596-4840-4b47-933b-2c64c2e80253 is going to be updated. [ 816.622376] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.622601] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.622665] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.622919] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.623063] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.623286] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4d3e596-4840-4b47-933b-2c64c2e80253" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.675771] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.675771] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.675771] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.675771] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.675998] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.701706] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 in Status: IN_PROGRESS for 2s [ 817.189054] env[69506]: INFO networking_nsxv3.common.synchronization [req-b5a5f464-da14-4ecf-bc3c-a140cf8fbe4e req-6a49e070-7bf9-4a3e-afcf-36c1aa525adc tempest-ServersTestManualDisk-744845154 tempest-ServersTestManualDisk-744845154-project-member] Enqueued Resource ID: 77834f91-37e7-4feb-86e1-583e68d3d852 with Priority: HIGHEST for action security_group_members [ 817.189054] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77834f91-37e7-4feb-86e1-583e68d3d852 with Priority: HIGHEST for action security_group_members [ 817.189054] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-77834f91-37e7-4feb-86e1-583e68d3d852 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.189054] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.190369] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.191661] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.191661] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.191661] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.191661] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.191661] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.191661] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.191661] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77834f91-37e7-4feb-86e1-583e68d3d852',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.240706] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56702d6b-7f85-46e1-bf9f-c5bba683fb41 in Status: SUCCESS [ 817.240706] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56702d6b-7f85-46e1-bf9f-c5bba683fb41 deletion is rescheduled due to dependency. [ 817.240706] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56702d6b-7f85-46e1-bf9f-c5bba683fb41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.240975] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 706a5462-e893-428d-beb2-737cbec00439 in Status: SUCCESS [ 817.241154] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.241606] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.241839] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.243188] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.243188] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.243188] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.243188] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.243188] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.243188] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.462685] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05c6d62a-58f1-418b-815e-8b3f7f5cd5eb in Status: SUCCESS [ 817.462685] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.462685] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.462892] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.463980] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.463980] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.463980] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.463980] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.463980] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.463980] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.463980] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('05c6d62a-58f1-418b-815e-8b3f7f5cd5eb',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.698832] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.699056] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.699144] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.699363] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.699454] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.699655] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.699777] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.699841] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.700017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.700085] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.700173] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77834f91-37e7-4feb-86e1-583e68d3d852 already deleted. [ 817.700269] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.744865] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.838768] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-365 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.838768] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-365" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.838900] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-365" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.839148] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-365" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.839411] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.839566] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.841020] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.841020] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.841020] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.841020] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 817.841020] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 817.841020] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 817.841020] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 817.841020] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 817.841020] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 817.841020] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 817.860157] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 817.860157] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 817.860157] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 817.860157] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-365" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.860157] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-06364fd8-214f-4427-a7b8-f91006198181 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.860157] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-06364fd8-214f-4427-a7b8-f91006198181" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.860157] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-06364fd8-214f-4427-a7b8-f91006198181" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.860157] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-06364fd8-214f-4427-a7b8-f91006198181" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.860157] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06364fd8-214f-4427-a7b8-f91006198181',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.967280] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.967280] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.967280] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.967280] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.967280] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.967280] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.967280] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.967280] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.967280] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.967653] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.967653] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.967653] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.967653] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.967996] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.967996] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.967996] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.968129] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.968826] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.968826] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.968826] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.968826] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('05c6d62a-58f1-418b-815e-8b3f7f5cd5eb',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.246647] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.365283] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.365661] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.365782] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.366092] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.366266] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.366451] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 06364fd8-214f-4427-a7b8-f91006198181 not found, creating... [ 818.366797] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.366989] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.367177] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.367669] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.367793] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.367993] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.368307] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.368307] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.368542] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.368754] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.368917] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 06364fd8-214f-4427-a7b8-f91006198181 is going to be created. [ 818.388703] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.388950] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.389107] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.389366] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.389586] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.389838] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-06364fd8-214f-4427-a7b8-f91006198181" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.470839] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 05c6d62a-58f1-418b-815e-8b3f7f5cd5eb: rpc.has_security_group_logging(os_id): False [ 818.494388] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.494592] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.494696] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.494820] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.494907] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.495135] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.495249] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.495361] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.495528] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.495600] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.495803] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.495985] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.495985] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.497441] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.497441] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.497441] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.497441] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.497441] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.497441] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.497441] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.497441] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05c6d62a-58f1-418b-815e-8b3f7f5cd5eb is going to be created. [ 818.561030] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.561188] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.561188] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.561501] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.561677] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.571956] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05c6d62a-58f1-418b-815e-8b3f7f5cd5eb in Status: IN_PROGRESS for 2s [ 818.717550] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 in Status: SUCCESS [ 818.717550] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.753148] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.753404] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.753474] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.753675] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.753769] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.753869] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 706a5462-e893-428d-beb2-737cbec00439 is going to be updated. [ 818.793625] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.793785] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.793838] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.794155] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.794309] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.806458] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 706a5462-e893-428d-beb2-737cbec00439 in Status: IN_PROGRESS for 2s [ 818.921945] env[69506]: INFO networking_nsxv3.common.synchronization [req-168b4027-4c9e-4be6-8426-4cbd40fcf65d req-59b2f24a-69c8-489a-a48b-10d219c16795 tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: 2517f7a1-fddd-463b-9fe1-c71acfb13743 with Priority: HIGHEST for action security_group_members [ 818.922163] env[69506]: INFO networking_nsxv3.common.synchronization [req-168b4027-4c9e-4be6-8426-4cbd40fcf65d req-59b2f24a-69c8-489a-a48b-10d219c16795 tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_members [ 818.922652] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2517f7a1-fddd-463b-9fe1-c71acfb13743 with Priority: HIGHEST for action security_group_members [ 818.922789] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_members [ 818.923263] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-2517f7a1-fddd-463b-9fe1-c71acfb13743 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.923381] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.923496] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.923702] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.923871] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.923974] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.924041] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.924189] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.924267] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.924360] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2517f7a1-fddd-463b-9fe1-c71acfb13743',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.925177] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a27cb9c-bb13-44cb-a531-49610a94a36e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.925583] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.925583] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.925583] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.925762] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.925762] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.925762] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.926015] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.926015] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.926112] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.990810] env[69506]: INFO networking_nsxv3.common.synchronization [req-168b4027-4c9e-4be6-8426-4cbd40fcf65d req-59b2f24a-69c8-489a-a48b-10d219c16795 tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_rules [ 818.990901] env[69506]: INFO networking_nsxv3.common.synchronization [req-168b4027-4c9e-4be6-8426-4cbd40fcf65d req-59b2f24a-69c8-489a-a48b-10d219c16795 tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_members [ 818.991052] env[69506]: INFO networking_nsxv3.common.synchronization [req-168b4027-4c9e-4be6-8426-4cbd40fcf65d req-59b2f24a-69c8-489a-a48b-10d219c16795 tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: 2517f7a1-fddd-463b-9fe1-c71acfb13743 with Priority: HIGHEST for action security_group_rules [ 818.991251] env[69506]: INFO networking_nsxv3.common.synchronization [req-168b4027-4c9e-4be6-8426-4cbd40fcf65d req-59b2f24a-69c8-489a-a48b-10d219c16795 tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: 2517f7a1-fddd-463b-9fe1-c71acfb13743 with Priority: HIGHEST for action security_group_members [ 818.991402] env[69506]: INFO networking_nsxv3.common.synchronization [req-168b4027-4c9e-4be6-8426-4cbd40fcf65d req-59b2f24a-69c8-489a-a48b-10d219c16795 tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: fa8149fe-ca30-4921-8ef2-8835531a6595 with Priority: HIGHEST for action port [ 818.996313] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_rules [ 818.996313] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2517f7a1-fddd-463b-9fe1-c71acfb13743 with Priority: HIGHEST for action security_group_rules [ 818.996313] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa8149fe-ca30-4921-8ef2-8835531a6595 with Priority: HIGHEST for action port [ 818.996313] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_members [ 818.996313] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2517f7a1-fddd-463b-9fe1-c71acfb13743 with Priority: HIGHEST for action security_group_members [ 818.996792] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a27cb9c-bb13-44cb-a531-49610a94a36e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.997286] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.000930] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.000930] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.000930] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.000930] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2517f7a1-fddd-463b-9fe1-c71acfb13743 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.000930] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.000930] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.001729] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.001789] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2517f7a1-fddd-463b-9fe1-c71acfb13743',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.002605] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa8149fe-ca30-4921-8ef2-8835531a6595 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.003739] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa8149fe-ca30-4921-8ef2-8835531a6595" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.003739] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa8149fe-ca30-4921-8ef2-8835531a6595" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.003739] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa8149fe-ca30-4921-8ef2-8835531a6595" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.003739] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa8149fe-ca30-4921-8ef2-8835531a6595',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.004051] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a27cb9c-bb13-44cb-a531-49610a94a36e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.004103] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.004591] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-2517f7a1-fddd-463b-9fe1-c71acfb13743 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.004591] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.428020] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2517f7a1-fddd-463b-9fe1-c71acfb13743',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.429291] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.475924] env[69506]: INFO networking_nsxv3.common.synchronization [req-b5a5f464-da14-4ecf-bc3c-a140cf8fbe4e req-3339ba49-2adb-4e8d-a812-5571197b9358 service nova] Enqueued Resource ID: 77834f91-37e7-4feb-86e1-583e68d3d852 with Priority: HIGHEST for action security_group_rules [ 819.476133] env[69506]: INFO networking_nsxv3.common.synchronization [req-b5a5f464-da14-4ecf-bc3c-a140cf8fbe4e req-3339ba49-2adb-4e8d-a812-5571197b9358 service nova] Enqueued Resource ID: 77834f91-37e7-4feb-86e1-583e68d3d852 with Priority: HIGHEST for action security_group_members [ 819.476275] env[69506]: INFO networking_nsxv3.common.synchronization [req-b5a5f464-da14-4ecf-bc3c-a140cf8fbe4e req-3339ba49-2adb-4e8d-a812-5571197b9358 service nova] Enqueued Resource ID: 06364fd8-214f-4427-a7b8-f91006198181 with Priority: HIGHEST for action port [ 819.476544] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77834f91-37e7-4feb-86e1-583e68d3d852 with Priority: HIGHEST for action security_group_rules [ 819.476725] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77834f91-37e7-4feb-86e1-583e68d3d852 with Priority: HIGHEST for action security_group_members [ 819.476841] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06364fd8-214f-4427-a7b8-f91006198181 with Priority: HIGHEST for action port [ 819.477359] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77834f91-37e7-4feb-86e1-583e68d3d852 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.477492] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.477577] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.477770] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.477856] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77834f91-37e7-4feb-86e1-583e68d3d852',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.482305] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-77834f91-37e7-4feb-86e1-583e68d3d852 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.485727] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.485727] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.485727] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.485727] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.485727] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.485727] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.485727] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.485727] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.485727] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77834f91-37e7-4feb-86e1-583e68d3d852',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.486660] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-06364fd8-214f-4427-a7b8-f91006198181 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.486660] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06364fd8-214f-4427-a7b8-f91006198181" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.486660] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06364fd8-214f-4427-a7b8-f91006198181" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.486660] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06364fd8-214f-4427-a7b8-f91006198181" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.486660] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06364fd8-214f-4427-a7b8-f91006198181',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.505355] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a27cb9c-bb13-44cb-a531-49610a94a36e taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.505499] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.508411] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fa8149fe-ca30-4921-8ef2-8835531a6595 with status ACTIVE [ 819.508607] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.508911] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.508911] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.509096] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.509172] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.509371] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.509964] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.509964] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.509964] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.509964] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.509964] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.510331] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.510331] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.510331] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.510525] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.510671] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fa8149fe-ca30-4921-8ef2-8835531a6595 is going to be updated. [ 819.512905] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-2517f7a1-fddd-463b-9fe1-c71acfb13743 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.513110] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.534961] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.535203] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.535301] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.535566] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.535641] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.535838] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa8149fe-ca30-4921-8ef2-8835531a6595" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.652116] env[69506]: INFO networking_nsxv3.common.synchronization [req-79e389dd-8e88-4c60-9e44-364abe1512d8 req-eb322322-bd6c-4014-9cd3-48de3bc55646 tempest-ServerRescueTestJSON-235851791 tempest-ServerRescueTestJSON-235851791-project-member] Enqueued Resource ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 with Priority: HIGHEST for action security_group_members [ 819.652116] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 with Priority: HIGHEST for action security_group_members [ 819.652613] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-65fb79f7-95e7-4be9-b5bb-64c57bc42333 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.652769] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.652843] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.653717] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.654090] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.654323] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.654323] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.654996] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.654996] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.654996] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65fb79f7-95e7-4be9-b5bb-64c57bc42333',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.935122] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2517f7a1-fddd-463b-9fe1-c71acfb13743',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.936442] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.993088] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-77834f91-37e7-4feb-86e1-583e68d3d852 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.993223] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.993415] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77834f91-37e7-4feb-86e1-583e68d3d852',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.996774] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 06364fd8-214f-4427-a7b8-f91006198181 with status ACTIVE [ 819.996931] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.997052] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.997122] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.997337] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.997429] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.997682] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.997741] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.997795] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.997945] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.998036] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.998245] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.998340] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.998403] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.998541] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.998615] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.998734] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 06364fd8-214f-4427-a7b8-f91006198181 is going to be updated. [ 820.020442] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.020598] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.020649] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.020940] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.021204] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.021410] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06364fd8-214f-4427-a7b8-f91006198181" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.111688] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-201 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.111904] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-201" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.112351] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-201" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.112596] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-201" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.112904] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.113116] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.113247] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.113542] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.113684] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.113902] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 820.114069] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 820.114232] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 820.114354] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 820.114546] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 820.114726] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 820.114883] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 820.139058] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 820.139225] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 820.139346] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 820.139521] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-201" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.139926] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-639fc5a3-cbdf-468a-a198-02e4c38fc531 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.140128] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-639fc5a3-cbdf-468a-a198-02e4c38fc531" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.140270] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-639fc5a3-cbdf-468a-a198-02e4c38fc531" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.140654] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-639fc5a3-cbdf-468a-a198-02e4c38fc531" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.140795] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('639fc5a3-cbdf-468a-a198-02e4c38fc531',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.156258] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('65fb79f7-95e7-4be9-b5bb-64c57bc42333',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.440276] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.440276] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.440276] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.440276] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.440276] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.440276] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2517f7a1-fddd-463b-9fe1-c71acfb13743 is going to be created. [ 820.440802] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.440971] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.440971] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.441154] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.441237] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.441324] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e is going to be updated. [ 820.464788] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.464974] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.465082] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.465822] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.465990] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.469632] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.471335] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.471425] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.471616] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.471826] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.476674] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2517f7a1-fddd-463b-9fe1-c71acfb13743 in Status: UNINITIALIZED for 2s [ 820.479027] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e in Status: IN_PROGRESS for 2s [ 820.500746] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77834f91-37e7-4feb-86e1-583e68d3d852',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.583471] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05c6d62a-58f1-418b-815e-8b3f7f5cd5eb in Status: SUCCESS [ 820.585159] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.647017] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.647650] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.648151] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.648885] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.649110] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.649503] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 639fc5a3-cbdf-468a-a198-02e4c38fc531 not found, creating... [ 820.650024] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.650632] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.650860] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.651614] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.651795] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.652151] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.652318] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.652437] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.652671] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.652815] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.652959] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 639fc5a3-cbdf-468a-a198-02e4c38fc531 is going to be created. [ 820.660488] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('65fb79f7-95e7-4be9-b5bb-64c57bc42333',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.680042] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.680300] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.680426] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.680745] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.681034] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.681330] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-639fc5a3-cbdf-468a-a198-02e4c38fc531" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.818091] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 706a5462-e893-428d-beb2-737cbec00439 in Status: SUCCESS [ 820.818405] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.818541] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.818824] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.819072] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.819179] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.819239] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.819419] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.819505] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.819610] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.819707] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.004520] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.004741] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.004741] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.004981] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.005119] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.005174] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77834f91-37e7-4feb-86e1-583e68d3d852 is going to be created. [ 821.033479] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.033759] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.033759] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.033912] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.034083] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.043460] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77834f91-37e7-4feb-86e1-583e68d3d852 in Status: UNINITIALIZED for 2s [ 821.166290] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.166290] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.166290] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.166290] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.166290] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.166290] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 is going to be updated. [ 821.240705] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.240705] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.240705] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.240705] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.240705] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.251178] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 in Status: IN_PROGRESS for 2s [ 821.325031] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-706a5462-e893-428d-beb2-737cbec00439 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.325031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.325031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.325031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.325031] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.325031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.325031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.325031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.325031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.325031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.325031] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-706a5462-e893-428d-beb2-737cbec00439 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.325031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.325031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.325031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.325031] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.325031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.325676] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.325676] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.325676] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.325676] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.325676] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.613678] env[69506]: INFO networking_nsxv3.common.synchronization [req-79e389dd-8e88-4c60-9e44-364abe1512d8 req-25542ea4-d98e-4f0e-a2de-808ace6f48b0 service nova] Enqueued Resource ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 with Priority: HIGHEST for action security_group_rules [ 821.614462] env[69506]: INFO networking_nsxv3.common.synchronization [req-79e389dd-8e88-4c60-9e44-364abe1512d8 req-25542ea4-d98e-4f0e-a2de-808ace6f48b0 service nova] Enqueued Resource ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 with Priority: HIGHEST for action security_group_members [ 821.615931] env[69506]: INFO networking_nsxv3.common.synchronization [req-79e389dd-8e88-4c60-9e44-364abe1512d8 req-25542ea4-d98e-4f0e-a2de-808ace6f48b0 service nova] Enqueued Resource ID: 639fc5a3-cbdf-468a-a198-02e4c38fc531 with Priority: HIGHEST for action port [ 821.615931] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 with Priority: HIGHEST for action security_group_rules [ 821.615931] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 with Priority: HIGHEST for action security_group_members [ 821.615931] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 639fc5a3-cbdf-468a-a198-02e4c38fc531 with Priority: HIGHEST for action port [ 821.618806] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65fb79f7-95e7-4be9-b5bb-64c57bc42333 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.618806] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.618806] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.618806] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.618806] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65fb79f7-95e7-4be9-b5bb-64c57bc42333',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.620042] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-65fb79f7-95e7-4be9-b5bb-64c57bc42333 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.621022] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.621022] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-639fc5a3-cbdf-468a-a198-02e4c38fc531 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.621022] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-639fc5a3-cbdf-468a-a198-02e4c38fc531" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.621022] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-639fc5a3-cbdf-468a-a198-02e4c38fc531" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.621289] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-639fc5a3-cbdf-468a-a198-02e4c38fc531" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.621289] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('639fc5a3-cbdf-468a-a198-02e4c38fc531',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.831083] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 706a5462-e893-428d-beb2-737cbec00439: rpc.has_security_group_logging(os_id): False [ 821.849634] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.851609] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.851609] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.851609] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.851609] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.851609] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.851609] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.851609] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.852168] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.852464] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.852926] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.853271] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.853715] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.856024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.856024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.856024] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.856024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.856024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.856024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.856024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.856024] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 706a5462-e893-428d-beb2-737cbec00439 is going to be updated. [ 821.949083] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.949357] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.949357] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.949574] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.949753] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.967706] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 706a5462-e893-428d-beb2-737cbec00439 in Status: IN_PROGRESS for 2s [ 822.124642] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-65fb79f7-95e7-4be9-b5bb-64c57bc42333 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.124813] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.124993] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 639fc5a3-cbdf-468a-a198-02e4c38fc531 with status ACTIVE [ 822.125200] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.125340] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.125446] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.125696] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.125767] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.125941] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.126055] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.126118] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.126275] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.126354] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.126555] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.126663] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.126747] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.127100] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.127100] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.127100] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 639fc5a3-cbdf-468a-a198-02e4c38fc531 is going to be updated. [ 822.147411] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.147583] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.147658] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.147834] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.147966] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.152270] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-639fc5a3-cbdf-468a-a198-02e4c38fc531" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.170318] env[69506]: INFO networking_nsxv3.common.synchronization [None req-673c5bb4-384d-4eb4-a52c-fc11dd2f3af7 None None] Enqueued Resource ID: 3a30c4c1-72b2-447c-b3ab-bd2323cb93f4 with Priority: HIGHEST for action port [ 822.170582] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a30c4c1-72b2-447c-b3ab-bd2323cb93f4 with Priority: HIGHEST for action port [ 822.171160] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a30c4c1-72b2-447c-b3ab-bd2323cb93f4 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.171368] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a30c4c1-72b2-447c-b3ab-bd2323cb93f4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.171429] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a30c4c1-72b2-447c-b3ab-bd2323cb93f4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.171795] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a30c4c1-72b2-447c-b3ab-bd2323cb93f4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.171795] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a30c4c1-72b2-447c-b3ab-bd2323cb93f4',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.498544] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e in Status: SUCCESS [ 822.498544] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.498544] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2517f7a1-fddd-463b-9fe1-c71acfb13743 in Status: SUCCESS [ 822.498544] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.498544] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.498544] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.498544] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.498544] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.498544] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.498967] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.498967] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.498967] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.500153] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.500153] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.500153] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.500373] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.500373] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.500440] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.500510] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.500846] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2517f7a1-fddd-463b-9fe1-c71acfb13743',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.674358] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3a30c4c1-72b2-447c-b3ab-bd2323cb93f4 [ 822.674358] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.674358] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.674358] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.674917] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.674917] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.674917] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3a30c4c1-72b2-447c-b3ab-bd2323cb93f4 already deleted. [ 822.674917] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a30c4c1-72b2-447c-b3ab-bd2323cb93f4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.006363] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2517f7a1-fddd-463b-9fe1-c71acfb13743',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.008312] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.052975] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77834f91-37e7-4feb-86e1-583e68d3d852 in Status: SUCCESS [ 823.053315] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.053854] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.054152] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.054380] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.054556] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.054659] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.054849] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.054971] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.055123] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.055245] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('77834f91-37e7-4feb-86e1-583e68d3d852',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.263911] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 in Status: SUCCESS [ 823.267526] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.267599] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.270259] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.270259] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.270259] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.270259] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.270259] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.270259] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.270259] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65fb79f7-95e7-4be9-b5bb-64c57bc42333',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.510855] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2517f7a1-fddd-463b-9fe1-c71acfb13743',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.511982] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.560573] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('77834f91-37e7-4feb-86e1-583e68d3d852',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.770959] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('65fb79f7-95e7-4be9-b5bb-64c57bc42333',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.772927] env[69506]: INFO networking_nsxv3.common.synchronization [None req-b0915281-7d4d-4d4e-ae99-a32ae222e6e4 tempest-ServerActionsV293TestJSON-229040708 tempest-ServerActionsV293TestJSON-229040708-project-member] Enqueued Resource ID: 0210561b-43ff-434b-97ef-339a5d85a2a9 with Priority: HIGHEST for action security_group_rules [ 823.773663] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0210561b-43ff-434b-97ef-339a5d85a2a9 with Priority: HIGHEST for action security_group_rules [ 823.774883] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0210561b-43ff-434b-97ef-339a5d85a2a9 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.775115] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0210561b-43ff-434b-97ef-339a5d85a2a9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.775213] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0210561b-43ff-434b-97ef-339a5d85a2a9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.775810] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0210561b-43ff-434b-97ef-339a5d85a2a9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.775918] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0210561b-43ff-434b-97ef-339a5d85a2a9',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.914259] env[69506]: INFO networking_nsxv3.common.synchronization [None req-a9feda85-8287-48bf-9dc4-d28518bf09dd tempest-ServerActionsV293TestJSON-229040708 tempest-ServerActionsV293TestJSON-229040708-project-member] Enqueued Resource ID: 0210561b-43ff-434b-97ef-339a5d85a2a9 with Priority: HIGHEST for action security_group_rules [ 823.914865] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0210561b-43ff-434b-97ef-339a5d85a2a9 with Priority: HIGHEST for action security_group_rules [ 823.915547] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0210561b-43ff-434b-97ef-339a5d85a2a9 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.915719] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0210561b-43ff-434b-97ef-339a5d85a2a9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.980856] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 706a5462-e893-428d-beb2-737cbec00439 in Status: SUCCESS [ 823.981924] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.014460] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.015375] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.018020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.018020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.018020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.018020] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2517f7a1-fddd-463b-9fe1-c71acfb13743 is going to be updated. [ 824.018020] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.018020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.018020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.018020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.018020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.018020] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e is going to be updated. [ 824.049937] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.049937] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.049937] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.049937] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.049937] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.050936] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.051309] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.051309] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.051309] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.051420] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.060621] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2517f7a1-fddd-463b-9fe1-c71acfb13743 in Status: IN_PROGRESS for 2s [ 824.063263] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 77834f91-37e7-4feb-86e1-583e68d3d852: rpc.has_security_group_logging(os_id): False [ 824.063263] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e in Status: IN_PROGRESS for 2s [ 824.080248] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.080335] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.080379] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.080600] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.080688] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.080944] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.081075] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.081117] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.081262] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.081336] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.081423] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77834f91-37e7-4feb-86e1-583e68d3d852 is going to be created. [ 824.138682] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.138875] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.138925] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.139143] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.139332] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.154325] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77834f91-37e7-4feb-86e1-583e68d3d852 in Status: IN_PROGRESS for 2s [ 824.274731] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('65fb79f7-95e7-4be9-b5bb-64c57bc42333',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.294409] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.294565] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.294628] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.294838] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.294930] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.295037] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0210561b-43ff-434b-97ef-339a5d85a2a9 already deleted. [ 824.295124] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0210561b-43ff-434b-97ef-339a5d85a2a9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.295285] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0210561b-43ff-434b-97ef-339a5d85a2a9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.295409] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0210561b-43ff-434b-97ef-339a5d85a2a9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.295489] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0210561b-43ff-434b-97ef-339a5d85a2a9',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.445752] env[69506]: INFO networking_nsxv3.common.synchronization [None req-2bb94e4b-ebda-47fa-9e5d-997440c695ae None None] Enqueued Resource ID: 680410bc-95aa-4258-91a0-98bcc650fdf6 with Priority: HIGHEST for action port [ 824.445989] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 680410bc-95aa-4258-91a0-98bcc650fdf6 with Priority: HIGHEST for action port [ 824.446577] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-680410bc-95aa-4258-91a0-98bcc650fdf6 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.446703] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-680410bc-95aa-4258-91a0-98bcc650fdf6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.446767] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-680410bc-95aa-4258-91a0-98bcc650fdf6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.447039] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-680410bc-95aa-4258-91a0-98bcc650fdf6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.447131] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('680410bc-95aa-4258-91a0-98bcc650fdf6',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.776856] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.777188] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.777188] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.777323] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.777416] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.777517] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 is going to be updated. [ 824.809596] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.809796] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.809847] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.810038] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.810185] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.814271] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.814410] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.814496] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.814658] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.814746] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.814841] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0210561b-43ff-434b-97ef-339a5d85a2a9 already deleted. [ 824.814925] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0210561b-43ff-434b-97ef-339a5d85a2a9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.820072] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 in Status: IN_PROGRESS for 2s [ 824.948826] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 680410bc-95aa-4258-91a0-98bcc650fdf6 [ 824.949141] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.949245] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.949292] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.949498] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.949605] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.949701] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:680410bc-95aa-4258-91a0-98bcc650fdf6 already deleted. [ 824.949811] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-680410bc-95aa-4258-91a0-98bcc650fdf6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.124979] env[69506]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] NSXv3 Agent Agent loop - iteration:0 completed [ 825.125139] env[69506]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] NSXv3 Agent Agent loop - iteration:1 started [ 825.296337] env[69506]: INFO networking_nsxv3.common.synchronization [req-0fbd90b8-01f4-43b1-b9c2-c7f336a5d178 req-fff9a432-bc86-4416-8996-c5a66621161f tempest-ServerActionsTestJSON-78405165 tempest-ServerActionsTestJSON-78405165-project-member] Enqueued Resource ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 with Priority: HIGHEST for action security_group_members [ 825.296337] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 with Priority: HIGHEST for action security_group_members [ 825.296584] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.296703] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.296767] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.302405] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.302405] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.302405] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.302405] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.302405] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.302405] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.302405] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96b2c90a-a7a0-4dcb-8212-5e459d8d4793',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.769764] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-656 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.769764] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-656" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.769764] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-656" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.770113] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-656" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.770302] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.770469] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.770590] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.770826] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.770973] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.771942] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 825.772543] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 825.772543] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 825.772543] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 825.772543] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 825.772918] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 825.772918] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 825.795315] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 825.795952] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 825.795952] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 825.795952] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-656" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.796461] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-b93ed1ae-c3b5-440f-a5db-d2390f51968e taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.796461] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-b93ed1ae-c3b5-440f-a5db-d2390f51968e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.796461] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-b93ed1ae-c3b5-440f-a5db-d2390f51968e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.797540] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-b93ed1ae-c3b5-440f-a5db-d2390f51968e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.797540] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b93ed1ae-c3b5-440f-a5db-d2390f51968e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.803244] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.803244] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.803244] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.803244] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.803244] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.803732] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.803732] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.803732] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.803732] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.803732] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.804295] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 already deleted. [ 825.804295] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.071633] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e in Status: SUCCESS [ 826.072450] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.072450] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.072450] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.072450] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.072599] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.072599] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.073567] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.073567] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.073567] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.073567] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.075201] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2517f7a1-fddd-463b-9fe1-c71acfb13743 in Status: SUCCESS [ 826.075424] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.075842] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.075842] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.076029] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.076179] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.076272] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.076829] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.076829] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.076829] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.076829] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2517f7a1-fddd-463b-9fe1-c71acfb13743',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.164851] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77834f91-37e7-4feb-86e1-583e68d3d852 in Status: SUCCESS [ 826.165213] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.301864] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.302254] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.302474] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.303098] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.303098] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.304453] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port b93ed1ae-c3b5-440f-a5db-d2390f51968e not found, creating... [ 826.304453] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.304453] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.304453] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.304453] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.304734] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.305936] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.306359] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.306590] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.306988] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.307338] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.307592] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: b93ed1ae-c3b5-440f-a5db-d2390f51968e is going to be created. [ 826.330985] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.330985] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.330985] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.331352] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.331541] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.331844] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-b93ed1ae-c3b5-440f-a5db-d2390f51968e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.578584] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a27cb9c-bb13-44cb-a531-49610a94a36e taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.578864] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.579031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.579252] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.579456] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.579592] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.579643] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.579805] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.579941] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.580039] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.580690] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a27cb9c-bb13-44cb-a531-49610a94a36e taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.580690] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.580933] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.581010] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.581202] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.581348] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.581464] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.581690] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.581835] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.581969] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.582318] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.583271] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2517f7a1-fddd-463b-9fe1-c71acfb13743',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.830835] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 in Status: SUCCESS [ 826.830835] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.831322] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.831322] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.831410] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.831528] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.831601] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.831794] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.831882] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.832058] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.832058] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('65fb79f7-95e7-4be9-b5bb-64c57bc42333',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.911204] env[69506]: INFO networking_nsxv3.common.synchronization [req-fe04fa3f-11c0-4a61-bd7c-344a45f8fe14 req-03187dd4-3776-4690-a39e-41b6e81b2407 tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_members [ 826.911424] env[69506]: INFO networking_nsxv3.common.synchronization [req-fe04fa3f-11c0-4a61-bd7c-344a45f8fe14 req-03187dd4-3776-4690-a39e-41b6e81b2407 tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: eca48d39-e366-457e-ac9c-a357b0ccef14 with Priority: HIGHEST for action security_group_members [ 826.911575] env[69506]: INFO networking_nsxv3.common.synchronization [req-fe04fa3f-11c0-4a61-bd7c-344a45f8fe14 req-03187dd4-3776-4690-a39e-41b6e81b2407 tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: 2517f7a1-fddd-463b-9fe1-c71acfb13743 with Priority: HIGHEST for action security_group_members [ 826.912204] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_members [ 826.912343] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eca48d39-e366-457e-ac9c-a357b0ccef14 with Priority: HIGHEST for action security_group_members [ 826.912442] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2517f7a1-fddd-463b-9fe1-c71acfb13743 with Priority: HIGHEST for action security_group_members [ 826.912723] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a27cb9c-bb13-44cb-a531-49610a94a36e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.912844] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.912908] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.913142] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.913424] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.913517] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.913517] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.913667] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.913755] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.913853] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.914732] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-eca48d39-e366-457e-ac9c-a357b0ccef14 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.914855] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eca48d39-e366-457e-ac9c-a357b0ccef14" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.914907] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eca48d39-e366-457e-ac9c-a357b0ccef14" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.915135] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eca48d39-e366-457e-ac9c-a357b0ccef14" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.915288] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.915385] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.915440] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.915583] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.915661] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.915752] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eca48d39-e366-457e-ac9c-a357b0ccef14',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.916599] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-2517f7a1-fddd-463b-9fe1-c71acfb13743 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.916702] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.916775] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.916939] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.917102] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.917199] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.917256] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.917664] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.917664] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.917664] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2517f7a1-fddd-463b-9fe1-c71acfb13743',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.988586] env[69506]: INFO networking_nsxv3.common.synchronization [req-fe04fa3f-11c0-4a61-bd7c-344a45f8fe14 req-03187dd4-3776-4690-a39e-41b6e81b2407 tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_rules [ 826.988586] env[69506]: INFO networking_nsxv3.common.synchronization [req-fe04fa3f-11c0-4a61-bd7c-344a45f8fe14 req-03187dd4-3776-4690-a39e-41b6e81b2407 tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_members [ 826.988586] env[69506]: INFO networking_nsxv3.common.synchronization [req-fe04fa3f-11c0-4a61-bd7c-344a45f8fe14 req-03187dd4-3776-4690-a39e-41b6e81b2407 tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: 2517f7a1-fddd-463b-9fe1-c71acfb13743 with Priority: HIGHEST for action security_group_rules [ 826.988586] env[69506]: INFO networking_nsxv3.common.synchronization [req-fe04fa3f-11c0-4a61-bd7c-344a45f8fe14 req-03187dd4-3776-4690-a39e-41b6e81b2407 tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: 2517f7a1-fddd-463b-9fe1-c71acfb13743 with Priority: HIGHEST for action security_group_members [ 826.988586] env[69506]: INFO networking_nsxv3.common.synchronization [req-fe04fa3f-11c0-4a61-bd7c-344a45f8fe14 req-03187dd4-3776-4690-a39e-41b6e81b2407 tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: eca48d39-e366-457e-ac9c-a357b0ccef14 with Priority: HIGHEST for action security_group_rules [ 826.988586] env[69506]: INFO networking_nsxv3.common.synchronization [req-fe04fa3f-11c0-4a61-bd7c-344a45f8fe14 req-03187dd4-3776-4690-a39e-41b6e81b2407 tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: eca48d39-e366-457e-ac9c-a357b0ccef14 with Priority: HIGHEST for action security_group_members [ 826.988586] env[69506]: INFO networking_nsxv3.common.synchronization [req-fe04fa3f-11c0-4a61-bd7c-344a45f8fe14 req-03187dd4-3776-4690-a39e-41b6e81b2407 tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: fa8149fe-ca30-4921-8ef2-8835531a6595 with Priority: HIGHEST for action port [ 826.988586] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_rules [ 826.988586] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2517f7a1-fddd-463b-9fe1-c71acfb13743 with Priority: HIGHEST for action security_group_rules [ 826.992085] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eca48d39-e366-457e-ac9c-a357b0ccef14 with Priority: HIGHEST for action security_group_members [ 826.992085] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa8149fe-ca30-4921-8ef2-8835531a6595 with Priority: HIGHEST for action port [ 826.992085] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eca48d39-e366-457e-ac9c-a357b0ccef14 with Priority: HIGHEST for action security_group_rules [ 826.992085] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_members [ 826.992085] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2517f7a1-fddd-463b-9fe1-c71acfb13743 with Priority: HIGHEST for action security_group_members [ 826.992085] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a27cb9c-bb13-44cb-a531-49610a94a36e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.992085] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.992085] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2517f7a1-fddd-463b-9fe1-c71acfb13743 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.992085] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.992085] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-eca48d39-e366-457e-ac9c-a357b0ccef14 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.992085] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eca48d39-e366-457e-ac9c-a357b0ccef14" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.992085] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa8149fe-ca30-4921-8ef2-8835531a6595 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.992085] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa8149fe-ca30-4921-8ef2-8835531a6595" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.992085] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa8149fe-ca30-4921-8ef2-8835531a6595" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.992085] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa8149fe-ca30-4921-8ef2-8835531a6595" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.992085] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa8149fe-ca30-4921-8ef2-8835531a6595',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.992085] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eca48d39-e366-457e-ac9c-a357b0ccef14 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.992085] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eca48d39-e366-457e-ac9c-a357b0ccef14" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.992085] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eca48d39-e366-457e-ac9c-a357b0ccef14" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.993232] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eca48d39-e366-457e-ac9c-a357b0ccef14" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.993232] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eca48d39-e366-457e-ac9c-a357b0ccef14',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.993232] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a27cb9c-bb13-44cb-a531-49610a94a36e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.993232] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.993232] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-2517f7a1-fddd-463b-9fe1-c71acfb13743 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.993232] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.085048] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a27cb9c-bb13-44cb-a531-49610a94a36e: rpc.has_security_group_logging(os_id): False [ 827.088083] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2517f7a1-fddd-463b-9fe1-c71acfb13743: rpc.has_security_group_logging(os_id): False [ 827.105568] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.105568] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.105568] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.105568] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.105568] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.105568] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.105568] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.105568] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.105568] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.105568] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.105568] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.105568] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.105568] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.106242] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.106242] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.106242] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.106242] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.106242] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.106242] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.106488] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.106488] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e is going to be updated. [ 827.108151] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.108389] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.108389] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.108686] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.108686] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.108871] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.108871] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.109067] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.109067] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.109720] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.109720] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2517f7a1-fddd-463b-9fe1-c71acfb13743 is going to be created. [ 827.168214] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.168373] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.168494] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.168614] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.168851] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.171058] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.171058] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.171058] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.171437] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.171437] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.186034] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2517f7a1-fddd-463b-9fe1-c71acfb13743 in Status: IN_PROGRESS for 2s [ 827.193019] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e in Status: IN_PROGRESS for 2s [ 827.209696] env[69506]: INFO networking_nsxv3.common.synchronization [req-a042d187-af55-44d3-b546-165a60a1ded4 req-8122b2e5-9ad6-4156-b4de-1892e22f27c9 tempest-ServerTagsTestJSON-157450972 tempest-ServerTagsTestJSON-157450972-project-member] Enqueued Resource ID: d1fc353c-0404-4f16-bed0-42c4e9a557a3 with Priority: HIGHEST for action security_group_members [ 827.210733] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1fc353c-0404-4f16-bed0-42c4e9a557a3 with Priority: HIGHEST for action security_group_members [ 827.210733] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1fc353c-0404-4f16-bed0-42c4e9a557a3 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.210733] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1fc353c-0404-4f16-bed0-42c4e9a557a3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.210912] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1fc353c-0404-4f16-bed0-42c4e9a557a3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.210995] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1fc353c-0404-4f16-bed0-42c4e9a557a3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.211304] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.211413] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.211477] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.211632] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.211712] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.211805] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1fc353c-0404-4f16-bed0-42c4e9a557a3',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.334113] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-65fb79f7-95e7-4be9-b5bb-64c57bc42333 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.334593] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.334593] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.334593] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.334826] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.334875] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.334938] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.335155] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.335250] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.335353] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.335503] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-65fb79f7-95e7-4be9-b5bb-64c57bc42333 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.335593] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.335662] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.335817] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.335984] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.336098] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.336158] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.336305] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.336384] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.338418] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.338418] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('65fb79f7-95e7-4be9-b5bb-64c57bc42333',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.419670] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eca48d39-e366-457e-ac9c-a357b0ccef14',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.420808] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.421611] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2517f7a1-fddd-463b-9fe1-c71acfb13743',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.473465] env[69506]: INFO networking_nsxv3.common.synchronization [req-0fbd90b8-01f4-43b1-b9c2-c7f336a5d178 req-70c20a2d-b9d2-4be0-8e08-96ae3be4a3bf service nova] Enqueued Resource ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 with Priority: HIGHEST for action security_group_rules [ 827.473736] env[69506]: INFO networking_nsxv3.common.synchronization [req-0fbd90b8-01f4-43b1-b9c2-c7f336a5d178 req-70c20a2d-b9d2-4be0-8e08-96ae3be4a3bf service nova] Enqueued Resource ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 with Priority: HIGHEST for action security_group_members [ 827.473795] env[69506]: INFO networking_nsxv3.common.synchronization [req-0fbd90b8-01f4-43b1-b9c2-c7f336a5d178 req-70c20a2d-b9d2-4be0-8e08-96ae3be4a3bf service nova] Enqueued Resource ID: b93ed1ae-c3b5-440f-a5db-d2390f51968e with Priority: HIGHEST for action port [ 827.475523] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 with Priority: HIGHEST for action security_group_rules [ 827.475685] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 with Priority: HIGHEST for action security_group_members [ 827.475779] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b93ed1ae-c3b5-440f-a5db-d2390f51968e with Priority: HIGHEST for action port [ 827.476618] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.476859] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.476859] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.476938] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.477127] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('96b2c90a-a7a0-4dcb-8212-5e459d8d4793',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.478761] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.478761] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.478761] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.478761] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.478761] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.479025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.479025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.483273] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.483370] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.483457] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96b2c90a-a7a0-4dcb-8212-5e459d8d4793',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.484478] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-b93ed1ae-c3b5-440f-a5db-d2390f51968e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.484612] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b93ed1ae-c3b5-440f-a5db-d2390f51968e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.484682] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b93ed1ae-c3b5-440f-a5db-d2390f51968e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.485338] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b93ed1ae-c3b5-440f-a5db-d2390f51968e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.485338] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b93ed1ae-c3b5-440f-a5db-d2390f51968e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.495599] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-eca48d39-e366-457e-ac9c-a357b0ccef14 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.495745] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eca48d39-e366-457e-ac9c-a357b0ccef14" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.495983] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fa8149fe-ca30-4921-8ef2-8835531a6595 with status ACTIVE [ 827.496227] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.496451] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.496667] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.496966] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.497112] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.497731] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.497731] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.497731] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.498104] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.498104] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.498179] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.498314] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.498400] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.498603] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.499065] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.499065] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fa8149fe-ca30-4921-8ef2-8835531a6595 is going to be updated. [ 827.520599] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.520838] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.521108] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.521195] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.522287] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.522287] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa8149fe-ca30-4921-8ef2-8835531a6595" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.713524] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.713681] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.713776] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.713960] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.714070] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.714273] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.714361] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.714656] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.714656] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.714656] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.714800] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1fc353c-0404-4f16-bed0-42c4e9a557a3 is going to be updated. [ 827.742363] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.742508] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.742689] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.742832] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.742984] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.753190] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1fc353c-0404-4f16-bed0-42c4e9a557a3 in Status: IN_PROGRESS for 2s [ 827.838554] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 65fb79f7-95e7-4be9-b5bb-64c57bc42333: rpc.has_security_group_logging(os_id): False [ 827.857923] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.858085] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.858191] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.858415] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.858508] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.858749] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.858938] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.859369] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.859369] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.859369] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.859555] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.859616] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.859648] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.861311] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.861428] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.861780] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.861927] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.862023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.862630] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.862755] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.862843] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 is going to be updated. [ 827.923030] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eca48d39-e366-457e-ac9c-a357b0ccef14',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.924054] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.928040] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2517f7a1-fddd-463b-9fe1-c71acfb13743',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.928410] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.928410] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.928410] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.928644] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.928805] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.943759] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 in Status: IN_PROGRESS for 2s [ 827.987990] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.987990] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.987990] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('96b2c90a-a7a0-4dcb-8212-5e459d8d4793',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.988745] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b93ed1ae-c3b5-440f-a5db-d2390f51968e with status ACTIVE [ 827.988980] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.989115] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.989180] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.989471] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.989518] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.989654] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.989743] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.989875] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.989948] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.990482] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.990701] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.990800] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.990890] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.991052] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.991146] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.991235] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b93ed1ae-c3b5-440f-a5db-d2390f51968e is going to be updated. [ 828.023204] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.023350] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.023408] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.023701] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.023926] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.025539] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b93ed1ae-c3b5-440f-a5db-d2390f51968e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.426882] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.427095] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.427168] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.427381] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.427475] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.427607] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e is going to be updated. [ 828.429067] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.429187] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.429255] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.429423] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.429506] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.429595] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2517f7a1-fddd-463b-9fe1-c71acfb13743 is going to be updated. [ 828.432195] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.432195] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.432195] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.432195] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.432195] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.432195] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eca48d39-e366-457e-ac9c-a357b0ccef14 is going to be created. [ 828.463482] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.463641] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.463641] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.463842] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.464184] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.467431] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.467556] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.469060] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.469060] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.469060] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.474141] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.474283] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.474351] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.474560] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.474693] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.489240] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e in Status: IN_PROGRESS for 2s [ 828.490196] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2517f7a1-fddd-463b-9fe1-c71acfb13743 in Status: IN_PROGRESS for 2s [ 828.491809] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eca48d39-e366-457e-ac9c-a357b0ccef14 in Status: UNINITIALIZED for 2s [ 828.493447] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('96b2c90a-a7a0-4dcb-8212-5e459d8d4793',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.998160] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.998454] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.998454] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.998663] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.998764] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.998908] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 is going to be created. [ 829.023851] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.023851] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.023851] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.023851] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.023851] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.031286] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 in Status: UNINITIALIZED for 2s [ 829.208254] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2517f7a1-fddd-463b-9fe1-c71acfb13743 in Status: SUCCESS [ 829.208254] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.208254] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.208254] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.208254] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2517f7a1-fddd-463b-9fe1-c71acfb13743',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.213849] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e in Status: SUCCESS [ 829.214107] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.214298] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.214507] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.214595] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.710378] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-2517f7a1-fddd-463b-9fe1-c71acfb13743 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.710571] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.717155] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a27cb9c-bb13-44cb-a531-49610a94a36e taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.717373] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.762752] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1fc353c-0404-4f16-bed0-42c4e9a557a3 in Status: SUCCESS [ 829.762976] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1fc353c-0404-4f16-bed0-42c4e9a557a3 deletion is rescheduled due to dependency. [ 829.763095] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1fc353c-0404-4f16-bed0-42c4e9a557a3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.956487] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 in Status: SUCCESS [ 829.956809] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.505379] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2517f7a1-fddd-463b-9fe1-c71acfb13743 in Status: SUCCESS [ 830.505835] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.506038] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.506276] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.506482] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.506604] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.506690] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.506934] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.507041] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.507152] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2517f7a1-fddd-463b-9fe1-c71acfb13743',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.513389] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eca48d39-e366-457e-ac9c-a357b0ccef14 in Status: SUCCESS [ 830.513389] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eca48d39-e366-457e-ac9c-a357b0ccef14" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.513389] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e in Status: SUCCESS [ 830.513389] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.513389] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eca48d39-e366-457e-ac9c-a357b0ccef14" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.513667] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eca48d39-e366-457e-ac9c-a357b0ccef14" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.513667] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.513772] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.513772] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.513912] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.513985] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.514088] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eca48d39-e366-457e-ac9c-a357b0ccef14',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.514973] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.515072] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.515249] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.515326] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.515388] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.515524] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.515596] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.515683] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.018217] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2517f7a1-fddd-463b-9fe1-c71acfb13743',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.019415] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eca48d39-e366-457e-ac9c-a357b0ccef14',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.020155] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.044398] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 in Status: SUCCESS [ 831.044804] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.045258] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.045520] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.045735] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.045859] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.045927] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.046101] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.046201] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.046317] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.046414] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('96b2c90a-a7a0-4dcb-8212-5e459d8d4793',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.088666] env[69506]: INFO networking_nsxv3.common.synchronization [req-0b1a978d-75c7-4f26-9990-885926062487 req-27667906-6c16-4290-a280-316fccd64240 tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: 2517f7a1-fddd-463b-9fe1-c71acfb13743 with Priority: HIGHEST for action security_group_members [ 831.088919] env[69506]: INFO networking_nsxv3.common.synchronization [req-0b1a978d-75c7-4f26-9990-885926062487 req-27667906-6c16-4290-a280-316fccd64240 tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_members [ 831.089091] env[69506]: INFO networking_nsxv3.common.synchronization [req-0b1a978d-75c7-4f26-9990-885926062487 req-27667906-6c16-4290-a280-316fccd64240 tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: eca48d39-e366-457e-ac9c-a357b0ccef14 with Priority: HIGHEST for action security_group_members [ 831.089649] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2517f7a1-fddd-463b-9fe1-c71acfb13743 with Priority: HIGHEST for action security_group_members [ 831.093218] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_members [ 831.093218] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eca48d39-e366-457e-ac9c-a357b0ccef14 with Priority: HIGHEST for action security_group_members [ 831.093218] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-2517f7a1-fddd-463b-9fe1-c71acfb13743 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.093218] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.093417] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a27cb9c-bb13-44cb-a531-49610a94a36e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.093458] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.093631] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-eca48d39-e366-457e-ac9c-a357b0ccef14 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.093712] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eca48d39-e366-457e-ac9c-a357b0ccef14" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.521848] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2517f7a1-fddd-463b-9fe1-c71acfb13743',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.523192] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eca48d39-e366-457e-ac9c-a357b0ccef14',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.523619] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.549037] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('96b2c90a-a7a0-4dcb-8212-5e459d8d4793',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.025267] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.025450] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.025524] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.026056] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.026188] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.026448] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2517f7a1-fddd-463b-9fe1-c71acfb13743 is going to be updated. [ 832.028952] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.029172] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.029172] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.029399] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.029479] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.029559] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eca48d39-e366-457e-ac9c-a357b0ccef14 is going to be updated. [ 832.030854] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.030973] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.031059] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.031235] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.031314] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.031444] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e is going to be updated. [ 832.052443] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 96b2c90a-a7a0-4dcb-8212-5e459d8d4793: rpc.has_security_group_logging(os_id): False [ 832.067345] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.067345] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.067345] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.067667] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.067715] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.070502] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.070698] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.070739] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.070921] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.071085] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.072903] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.074197] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.074321] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.074548] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.074819] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.077682] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.077917] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.077917] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.078092] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.078355] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.078433] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.078524] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.078600] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.078897] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.079312] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.079456] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 is going to be created. [ 832.086566] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2517f7a1-fddd-463b-9fe1-c71acfb13743 in Status: IN_PROGRESS for 2s [ 832.088649] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eca48d39-e366-457e-ac9c-a357b0ccef14 in Status: IN_PROGRESS for 2s [ 832.089830] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e in Status: IN_PROGRESS for 2s [ 832.122801] env[69506]: INFO networking_nsxv3.common.synchronization [None req-3e42df6e-7603-4f2d-83ad-f697e4c9179b None None] Enqueued Resource ID: e26bde59-8a13-45e2-8a69-4583d49325b5 with Priority: HIGHEST for action port [ 832.123593] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e26bde59-8a13-45e2-8a69-4583d49325b5 with Priority: HIGHEST for action port [ 832.123942] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-e26bde59-8a13-45e2-8a69-4583d49325b5 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.124209] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e26bde59-8a13-45e2-8a69-4583d49325b5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.124315] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e26bde59-8a13-45e2-8a69-4583d49325b5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.124546] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e26bde59-8a13-45e2-8a69-4583d49325b5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.124642] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e26bde59-8a13-45e2-8a69-4583d49325b5',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.152883] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.152883] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.152883] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.152883] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.152883] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.182662] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 in Status: IN_PROGRESS for 2s [ 832.627283] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e26bde59-8a13-45e2-8a69-4583d49325b5 [ 832.627283] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.631163] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.631163] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.631460] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.631460] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.631460] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e26bde59-8a13-45e2-8a69-4583d49325b5 already deleted. [ 832.631961] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e26bde59-8a13-45e2-8a69-4583d49325b5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.100633] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e in Status: SUCCESS [ 834.100959] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.101580] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eca48d39-e366-457e-ac9c-a357b0ccef14 in Status: SUCCESS [ 834.101778] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eca48d39-e366-457e-ac9c-a357b0ccef14" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.103022] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2517f7a1-fddd-463b-9fe1-c71acfb13743 in Status: SUCCESS [ 834.103022] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.103022] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.103022] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.103468] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.103468] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.103468] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.103674] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.103674] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.104745] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.104745] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.104745] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eca48d39-e366-457e-ac9c-a357b0ccef14" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.105028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eca48d39-e366-457e-ac9c-a357b0ccef14" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.105028] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.105162] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.105234] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.105355] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.105486] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.105486] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eca48d39-e366-457e-ac9c-a357b0ccef14" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.105613] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eca48d39-e366-457e-ac9c-a357b0ccef14',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.106238] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.110035] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.110035] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.110035] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.110035] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.110035] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.110035] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.110035] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.110035] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2517f7a1-fddd-463b-9fe1-c71acfb13743',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.110035] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.110035] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.110035] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.110035] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.110035] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.110035] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.110035] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.110035] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.110035] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eca48d39-e366-457e-ac9c-a357b0ccef14" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.110035] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eca48d39-e366-457e-ac9c-a357b0ccef14" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.111202] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.111202] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.111202] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.111202] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.111202] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.111202] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eca48d39-e366-457e-ac9c-a357b0ccef14',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.111202] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.111202] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.111202] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.111818] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.111818] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.111818] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.111818] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.111818] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2517f7a1-fddd-463b-9fe1-c71acfb13743',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.193981] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 in Status: SUCCESS [ 834.194230] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.347339] env[69506]: INFO networking_nsxv3.common.synchronization [req-67b124fe-b6d4-4f51-9cfb-212aa9ee99fb req-943018d7-58cc-4c45-9fbd-e8c7f26cfdc4 tempest-ServersAdminNegativeTestJSON-1868968513 tempest-ServersAdminNegativeTestJSON-1868968513-project-member] Enqueued Resource ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 with Priority: HIGHEST for action security_group_members [ 834.348060] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 with Priority: HIGHEST for action security_group_members [ 834.351540] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-78caaaf6-868f-4043-93dd-d9a75a05d023 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.355727] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.355727] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.355727] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.355727] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.355727] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.355727] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.355727] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.355727] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.355727] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78caaaf6-868f-4043-93dd-d9a75a05d023',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.610097] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eca48d39-e366-457e-ac9c-a357b0ccef14',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.611207] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a27cb9c-bb13-44cb-a531-49610a94a36e taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.611342] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.613913] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.614827] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.614952] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.615049] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.615264] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.615351] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.615547] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.615644] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.615704] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.615860] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.615933] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.616032] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eca48d39-e366-457e-ac9c-a357b0ccef14 is going to be deleted. [ 834.617019] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2517f7a1-fddd-463b-9fe1-c71acfb13743',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.625456] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.625604] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.625675] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.625878] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.625962] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.626184] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.626277] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.626338] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.626494] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.626568] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.626670] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2517f7a1-fddd-463b-9fe1-c71acfb13743 is going to be updated. [ 834.664749] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.664897] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.665049] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.665279] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.666153] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.669101] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.669309] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.669370] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.670817] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.670817] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.670817] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eca48d39-e366-457e-ac9c-a357b0ccef14" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.676912] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2517f7a1-fddd-463b-9fe1-c71acfb13743 in Status: IN_PROGRESS for 2s [ 834.835955] env[69506]: INFO networking_nsxv3.common.synchronization [None req-accb7b2f-8f1f-4f64-be38-f1018c3f8447 None None] Enqueued Resource ID: 506d139a-8d77-40ac-a0a9-2e214b477e3c with Priority: HIGHEST for action port [ 834.836252] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 506d139a-8d77-40ac-a0a9-2e214b477e3c with Priority: HIGHEST for action port [ 834.837947] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-506d139a-8d77-40ac-a0a9-2e214b477e3c taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.837947] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-506d139a-8d77-40ac-a0a9-2e214b477e3c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.837947] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-506d139a-8d77-40ac-a0a9-2e214b477e3c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.841026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-506d139a-8d77-40ac-a0a9-2e214b477e3c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.841026] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('506d139a-8d77-40ac-a0a9-2e214b477e3c',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.855276] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78caaaf6-868f-4043-93dd-d9a75a05d023',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.113172] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eca48d39-e366-457e-ac9c-a357b0ccef14: rpc.has_security_group_logging(os_id): False [ 835.122433] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.130223] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2517f7a1-fddd-463b-9fe1-c71acfb13743: rpc.has_security_group_logging(os_id): False [ 835.135563] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.135750] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.135840] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.136082] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.136211] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.137060] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.137060] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.137060] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.137060] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.137060] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.137060] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eca48d39-e366-457e-ac9c-a357b0ccef14 is going to be created. [ 835.150262] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.150262] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.150262] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.150262] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.150262] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.150262] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.150262] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.150262] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.150262] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.150262] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.150262] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2517f7a1-fddd-463b-9fe1-c71acfb13743 is going to be updated. [ 835.156150] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/eca48d39-e366-457e-ac9c-a357b0ccef14], does not exist path=[/infra/domains/default/groups/eca48d39-e366-457e-ac9c-a357b0ccef14]."\n}' [ 835.156300] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eca48d39-e366-457e-ac9c-a357b0ccef14 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/eca48d39-e366-457e-ac9c-a357b0ccef14 [ 835.156418] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 835.162332] env[69506]: INFO networking_nsxv3.common.synchronization [req-04e8d441-2462-439f-8758-1409d2764600 req-eac9e3d0-f9f5-485a-9c2e-e418a5bcfd36 tempest-ServersWithSpecificFlavorTestJSON-989278643 tempest-ServersWithSpecificFlavorTestJSON-989278643-project-member] Enqueued Resource ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 with Priority: HIGHEST for action security_group_members [ 835.162980] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 with Priority: HIGHEST for action security_group_members [ 835.163291] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6908af9-f839-40b2-9ca2-1fd554ee1d78 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.163461] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.163526] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.163668] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.164475] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.164475] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.164475] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.164772] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.164772] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.164772] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6908af9-f839-40b2-9ca2-1fd554ee1d78',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.209862] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.209862] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.209862] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.209862] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.211680] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.211988] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.212122] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.212192] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.212389] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.212471] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.212707] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.212812] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.212871] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.214876] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.214876] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.214876] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eca48d39-e366-457e-ac9c-a357b0ccef14 is going to be created. [ 835.244577] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/eca48d39-e366-457e-ac9c-a357b0ccef14], does not exist path=[/infra/domains/default/groups/eca48d39-e366-457e-ac9c-a357b0ccef14]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/eca48d39-e366-457e-ac9c-a357b0ccef14 [ 835.244577] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eca48d39-e366-457e-ac9c-a357b0ccef14" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.244856] env[69506]: Traceback (most recent call last): [ 835.244917] env[69506]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 835.244917] env[69506]: return func(*args, **kwargs) [ 835.244917] env[69506]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 835.244917] env[69506]: res.raise_for_status() [ 835.244917] env[69506]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 835.244917] env[69506]: raise HTTPError(http_error_msg, response=self) [ 835.244917] env[69506]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/eca48d39-e366-457e-ac9c-a357b0ccef14 [ 835.244917] env[69506]: During handling of the above exception, another exception occurred: [ 835.244917] env[69506]: Traceback (most recent call last): [ 835.244917] env[69506]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 835.244917] env[69506]: listener.cb(fileno) [ 835.245318] env[69506]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 835.245318] env[69506]: result = function(*args, **kwargs) [ 835.245318] env[69506]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 835.245318] env[69506]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 835.245318] env[69506]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 835.245318] env[69506]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 835.245318] env[69506]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 835.245318] env[69506]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 835.245318] env[69506]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 835.245318] env[69506]: res.raise_for_status() [ 835.245318] env[69506]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 835.245318] env[69506]: raise HTTPError(http_error_msg, response=self) [ 835.245318] env[69506]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/eca48d39-e366-457e-ac9c-a357b0ccef14 [ 835.245318] env[69506]: Removing descriptor: 5 [ 835.247283] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.247283] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.247283] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.248440] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.248440] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.263084] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2517f7a1-fddd-463b-9fe1-c71acfb13743 in Status: IN_PROGRESS for 2s [ 835.345368] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 506d139a-8d77-40ac-a0a9-2e214b477e3c [ 835.345663] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.345885] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.345885] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.346811] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.346811] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.346811] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:506d139a-8d77-40ac-a0a9-2e214b477e3c already deleted. [ 835.346811] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-506d139a-8d77-40ac-a0a9-2e214b477e3c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.357365] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78caaaf6-868f-4043-93dd-d9a75a05d023',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.525021] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-795 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.525176] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-795" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.525261] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-795" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.525559] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-795" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.525838] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.529026] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.529026] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.529026] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.529026] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.529026] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 835.529026] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 835.529026] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 835.529026] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 835.529026] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 835.529026] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 835.529026] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 835.541379] env[69506]: INFO networking_nsxv3.common.synchronization [None req-55c0a1d2-7514-4806-aaa9-3df419879ac2 None None] Enqueued Resource ID: bf5860e9-a897-4ad5-84ba-92aad2a41d8d with Priority: HIGHEST for action port [ 835.541999] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf5860e9-a897-4ad5-84ba-92aad2a41d8d with Priority: HIGHEST for action port [ 835.545221] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf5860e9-a897-4ad5-84ba-92aad2a41d8d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.545221] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf5860e9-a897-4ad5-84ba-92aad2a41d8d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.545427] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf5860e9-a897-4ad5-84ba-92aad2a41d8d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.545564] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf5860e9-a897-4ad5-84ba-92aad2a41d8d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.545654] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf5860e9-a897-4ad5-84ba-92aad2a41d8d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.548938] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 835.548938] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 835.549137] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 835.549309] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-795" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.549696] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-795f7607-6855-4e30-9437-364a0f889cdb taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.549947] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-795f7607-6855-4e30-9437-364a0f889cdb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.550194] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-795f7607-6855-4e30-9437-364a0f889cdb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.550392] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-795f7607-6855-4e30-9437-364a0f889cdb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.550529] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('795f7607-6855-4e30-9437-364a0f889cdb',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.633068] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.633274] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.633402] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.635304] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.635451] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.637173] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e is going to be updated. [ 835.668240] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.668432] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.668432] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.668776] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.699954] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.700155] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.700591] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.700591] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.700715] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.704115] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.704442] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.705239] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.705239] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.705239] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.705239] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.705239] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 is going to be updated. [ 835.717099] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e in Status: IN_PROGRESS for 2s [ 835.763483] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.764235] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.764235] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.764235] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.764883] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.779609] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 in Status: IN_PROGRESS for 2s [ 835.860723] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.860986] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.861141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.861398] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.861556] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.861702] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 is going to be updated. [ 835.892021] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.892021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.892021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.892021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.892021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.900908] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 in Status: IN_PROGRESS for 2s [ 836.048761] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bf5860e9-a897-4ad5-84ba-92aad2a41d8d [ 836.048761] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.049043] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.049043] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.050031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.050031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.050031] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bf5860e9-a897-4ad5-84ba-92aad2a41d8d already deleted. [ 836.050031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf5860e9-a897-4ad5-84ba-92aad2a41d8d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.053201] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.056020] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.056020] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.056020] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.056020] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.056020] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 795f7607-6855-4e30-9437-364a0f889cdb not found, creating... [ 836.056020] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.056020] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.056020] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.056020] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.056020] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.064691] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.064691] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.064691] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.064691] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.064691] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.064691] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 795f7607-6855-4e30-9437-364a0f889cdb is going to be created. [ 836.088228] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.088440] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.088559] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.089564] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.089564] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.089564] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-795f7607-6855-4e30-9437-364a0f889cdb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.686921] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2517f7a1-fddd-463b-9fe1-c71acfb13743 in Status: SUCCESS [ 836.687260] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2517f7a1-fddd-463b-9fe1-c71acfb13743 deletion is rescheduled due to dependency. [ 836.687260] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.977579] env[69506]: INFO networking_nsxv3.common.synchronization [req-04e8d441-2462-439f-8758-1409d2764600 req-3116c3d4-fd86-43a8-ab1f-849773635372 service nova] Enqueued Resource ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 with Priority: HIGHEST for action security_group_rules [ 836.977779] env[69506]: INFO networking_nsxv3.common.synchronization [req-04e8d441-2462-439f-8758-1409d2764600 req-3116c3d4-fd86-43a8-ab1f-849773635372 service nova] Enqueued Resource ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 with Priority: HIGHEST for action security_group_members [ 836.977924] env[69506]: INFO networking_nsxv3.common.synchronization [req-04e8d441-2462-439f-8758-1409d2764600 req-3116c3d4-fd86-43a8-ab1f-849773635372 service nova] Enqueued Resource ID: 795f7607-6855-4e30-9437-364a0f889cdb with Priority: HIGHEST for action port [ 836.978169] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 with Priority: HIGHEST for action security_group_rules [ 836.978305] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 with Priority: HIGHEST for action security_group_members [ 836.978405] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 795f7607-6855-4e30-9437-364a0f889cdb with Priority: HIGHEST for action port [ 836.978995] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6908af9-f839-40b2-9ca2-1fd554ee1d78 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.981108] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.981198] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.981413] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.981519] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6908af9-f839-40b2-9ca2-1fd554ee1d78',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.982534] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6908af9-f839-40b2-9ca2-1fd554ee1d78 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.982634] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.982821] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-795f7607-6855-4e30-9437-364a0f889cdb taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.982918] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-795f7607-6855-4e30-9437-364a0f889cdb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.982984] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-795f7607-6855-4e30-9437-364a0f889cdb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.983187] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-795f7607-6855-4e30-9437-364a0f889cdb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.983268] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('795f7607-6855-4e30-9437-364a0f889cdb',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.286664] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2517f7a1-fddd-463b-9fe1-c71acfb13743 in Status: SUCCESS [ 837.289042] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.321612] env[69506]: INFO networking_nsxv3.common.synchronization [None req-5053fdf8-4268-41ca-b69e-afd43c3caea8 tempest-AttachVolumeNegativeTest-402732870 tempest-AttachVolumeNegativeTest-402732870-project-member] Enqueued Resource ID: 7dc294f2-c118-4967-a208-cb40fa247a04 with Priority: HIGHEST for action security_group_rules [ 837.322429] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dc294f2-c118-4967-a208-cb40fa247a04 with Priority: HIGHEST for action security_group_rules [ 837.322547] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7dc294f2-c118-4967-a208-cb40fa247a04 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.322676] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7dc294f2-c118-4967-a208-cb40fa247a04" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.322887] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7dc294f2-c118-4967-a208-cb40fa247a04" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.323049] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7dc294f2-c118-4967-a208-cb40fa247a04" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.323816] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7dc294f2-c118-4967-a208-cb40fa247a04',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.482027] env[69506]: INFO networking_nsxv3.common.synchronization [None req-0301b013-8269-49f4-89a1-35f58eada4ef tempest-AttachVolumeNegativeTest-402732870 tempest-AttachVolumeNegativeTest-402732870-project-member] Enqueued Resource ID: 7dc294f2-c118-4967-a208-cb40fa247a04 with Priority: HIGHEST for action security_group_rules [ 837.482581] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dc294f2-c118-4967-a208-cb40fa247a04 with Priority: HIGHEST for action security_group_rules [ 837.482908] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7dc294f2-c118-4967-a208-cb40fa247a04 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.484028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7dc294f2-c118-4967-a208-cb40fa247a04" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.487340] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6908af9-f839-40b2-9ca2-1fd554ee1d78 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.487420] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.487864] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 795f7607-6855-4e30-9437-364a0f889cdb with status ACTIVE [ 837.487864] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.487864] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.489848] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.490333] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.493360] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.493946] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.493946] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.493946] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.494201] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.494201] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.494342] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.494450] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.494506] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.497757] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.497757] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.497757] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 795f7607-6855-4e30-9437-364a0f889cdb is going to be updated. [ 837.518923] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.519133] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.519206] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.519374] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.519721] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.519721] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-795f7607-6855-4e30-9437-364a0f889cdb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.730977] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e in Status: SUCCESS [ 837.730977] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.730977] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.730977] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.730977] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.730977] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.730977] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.731883] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.731883] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.731883] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.731883] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a27cb9c-bb13-44cb-a531-49610a94a36e taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.732198] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.732198] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.732278] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.732433] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.732526] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.732584] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.733293] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.733293] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.733412] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.733478] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.790808] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 in Status: SUCCESS [ 837.791044] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 deletion is rescheduled due to dependency. [ 837.791177] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.791369] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.792797] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.793103] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.793268] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.793355] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.793729] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.794137] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.794335] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6908af9-f839-40b2-9ca2-1fd554ee1d78',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.843998] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.844125] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.844201] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.844437] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.844562] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.844666] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7dc294f2-c118-4967-a208-cb40fa247a04 already deleted. [ 837.844757] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7dc294f2-c118-4967-a208-cb40fa247a04" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.845420] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7dc294f2-c118-4967-a208-cb40fa247a04" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.845520] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7dc294f2-c118-4967-a208-cb40fa247a04" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.845575] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7dc294f2-c118-4967-a208-cb40fa247a04',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.909791] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 in Status: SUCCESS [ 837.910838] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.072350] env[69506]: INFO networking_nsxv3.common.synchronization [None req-1dc4f984-cb1d-4dc7-af40-e4a5f5c4d1ae None None] Enqueued Resource ID: c1f8882f-569c-41f2-adfc-6371c771c57e with Priority: HIGHEST for action port [ 838.072350] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1f8882f-569c-41f2-adfc-6371c771c57e with Priority: HIGHEST for action port [ 838.072350] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1f8882f-569c-41f2-adfc-6371c771c57e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.072350] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1f8882f-569c-41f2-adfc-6371c771c57e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.072350] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1f8882f-569c-41f2-adfc-6371c771c57e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.072350] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1f8882f-569c-41f2-adfc-6371c771c57e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.072350] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1f8882f-569c-41f2-adfc-6371c771c57e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.102162] env[69506]: INFO networking_nsxv3.common.synchronization [req-846b3fc3-239d-4031-96a8-c80bb99e95e5 req-c5c5a5c9-32d2-4029-84a0-32501597c9ec tempest-VolumesAdminNegativeTest-1438419906 tempest-VolumesAdminNegativeTest-1438419906-project-member] Enqueued Resource ID: 7e307bb5-2c7b-4260-88ec-90f13f2de5d2 with Priority: HIGHEST for action security_group_members [ 838.102162] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e307bb5-2c7b-4260-88ec-90f13f2de5d2 with Priority: HIGHEST for action security_group_members [ 838.102162] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e307bb5-2c7b-4260-88ec-90f13f2de5d2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.102162] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e307bb5-2c7b-4260-88ec-90f13f2de5d2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.102162] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e307bb5-2c7b-4260-88ec-90f13f2de5d2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.102162] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e307bb5-2c7b-4260-88ec-90f13f2de5d2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.104989] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.108031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.108031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.108031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.108031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.108031] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e307bb5-2c7b-4260-88ec-90f13f2de5d2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.237152] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a27cb9c-bb13-44cb-a531-49610a94a36e: rpc.has_security_group_logging(os_id): False [ 838.259904] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.260092] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.260147] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.260364] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.279214] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.279327] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.279459] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.279521] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.279801] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.279896] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.280158] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.280317] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.280317] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.280475] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.280610] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.280814] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.280989] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.281054] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.281166] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.281287] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.281476] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e is going to be updated. [ 838.298256] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6908af9-f839-40b2-9ca2-1fd554ee1d78',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.343866] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.344134] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.344134] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.344347] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.344531] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.369757] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e in Status: IN_PROGRESS for 2s [ 838.371239] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.371321] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.373018] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.374354] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.374459] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.374558] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7dc294f2-c118-4967-a208-cb40fa247a04 already deleted. [ 838.374640] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7dc294f2-c118-4967-a208-cb40fa247a04" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.574780] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c1f8882f-569c-41f2-adfc-6371c771c57e [ 838.574780] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.574780] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.574780] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.575672] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.575672] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.575781] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c1f8882f-569c-41f2-adfc-6371c771c57e already deleted. [ 838.576144] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1f8882f-569c-41f2-adfc-6371c771c57e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.584663] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-484 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.584861] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-484" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.585018] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-484" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.585963] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-484" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.585963] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.585963] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.585963] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.586311] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.589763] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.589763] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 838.589763] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 838.589763] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 838.589763] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 838.589763] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 838.589763] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 838.589763] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 838.605344] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 838.605839] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 838.605839] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 838.605839] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-484" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.606166] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-da8b2154-7ccc-42b1-bf6b-c7637399d2db taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.606337] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-da8b2154-7ccc-42b1-bf6b-c7637399d2db" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.606460] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-da8b2154-7ccc-42b1-bf6b-c7637399d2db" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.606832] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-da8b2154-7ccc-42b1-bf6b-c7637399d2db" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.607020] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da8b2154-7ccc-42b1-bf6b-c7637399d2db',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.612984] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.613143] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.613208] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.613554] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.613554] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.613724] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.613828] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.614761] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.614761] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.614761] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.614761] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e307bb5-2c7b-4260-88ec-90f13f2de5d2 already deleted. [ 838.614761] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e307bb5-2c7b-4260-88ec-90f13f2de5d2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.804426] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6908af9-f839-40b2-9ca2-1fd554ee1d78',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.110366] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.110540] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.110540] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.110842] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.110962] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.111144] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port da8b2154-7ccc-42b1-bf6b-c7637399d2db not found, creating... [ 839.111595] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.111807] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.111996] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.112684] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.112871] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.113194] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.113368] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.113452] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.113666] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.113796] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.113939] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: da8b2154-7ccc-42b1-bf6b-c7637399d2db is going to be created. [ 839.136517] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.136760] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.136834] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.137146] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.137400] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.137608] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-da8b2154-7ccc-42b1-bf6b-c7637399d2db" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.308482] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.308482] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.308482] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.308482] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.308482] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.308482] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 is going to be updated. [ 839.335018] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.335187] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.335255] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.335454] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.335587] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.353568] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 in Status: IN_PROGRESS for 2s [ 839.985537] env[69506]: INFO networking_nsxv3.common.synchronization [req-846b3fc3-239d-4031-96a8-c80bb99e95e5 req-9fda5e65-da53-4a8f-9f90-c2c190b46e87 service nova] Enqueued Resource ID: 7e307bb5-2c7b-4260-88ec-90f13f2de5d2 with Priority: HIGHEST for action security_group_rules [ 839.985840] env[69506]: INFO networking_nsxv3.common.synchronization [req-846b3fc3-239d-4031-96a8-c80bb99e95e5 req-9fda5e65-da53-4a8f-9f90-c2c190b46e87 service nova] Enqueued Resource ID: 7e307bb5-2c7b-4260-88ec-90f13f2de5d2 with Priority: HIGHEST for action security_group_members [ 839.985923] env[69506]: INFO networking_nsxv3.common.synchronization [req-846b3fc3-239d-4031-96a8-c80bb99e95e5 req-9fda5e65-da53-4a8f-9f90-c2c190b46e87 service nova] Enqueued Resource ID: da8b2154-7ccc-42b1-bf6b-c7637399d2db with Priority: HIGHEST for action port [ 839.986502] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e307bb5-2c7b-4260-88ec-90f13f2de5d2 with Priority: HIGHEST for action security_group_rules [ 839.986775] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e307bb5-2c7b-4260-88ec-90f13f2de5d2 with Priority: HIGHEST for action security_group_members [ 839.986904] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da8b2154-7ccc-42b1-bf6b-c7637399d2db with Priority: HIGHEST for action port [ 839.989648] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e307bb5-2c7b-4260-88ec-90f13f2de5d2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.989761] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e307bb5-2c7b-4260-88ec-90f13f2de5d2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.989761] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e307bb5-2c7b-4260-88ec-90f13f2de5d2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.990038] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e307bb5-2c7b-4260-88ec-90f13f2de5d2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.990134] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e307bb5-2c7b-4260-88ec-90f13f2de5d2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.991025] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e307bb5-2c7b-4260-88ec-90f13f2de5d2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.992894] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e307bb5-2c7b-4260-88ec-90f13f2de5d2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.992894] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e307bb5-2c7b-4260-88ec-90f13f2de5d2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.992894] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e307bb5-2c7b-4260-88ec-90f13f2de5d2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.992894] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.992894] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.992894] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.992894] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.992894] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.992894] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e307bb5-2c7b-4260-88ec-90f13f2de5d2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.993371] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-da8b2154-7ccc-42b1-bf6b-c7637399d2db taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.993371] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da8b2154-7ccc-42b1-bf6b-c7637399d2db" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.993371] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da8b2154-7ccc-42b1-bf6b-c7637399d2db" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.993507] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da8b2154-7ccc-42b1-bf6b-c7637399d2db" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.993755] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da8b2154-7ccc-42b1-bf6b-c7637399d2db',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.385947] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e in Status: SUCCESS [ 840.385947] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.497221] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e307bb5-2c7b-4260-88ec-90f13f2de5d2 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.497221] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e307bb5-2c7b-4260-88ec-90f13f2de5d2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.497221] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e307bb5-2c7b-4260-88ec-90f13f2de5d2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.497720] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port da8b2154-7ccc-42b1-bf6b-c7637399d2db with status ACTIVE [ 840.497775] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.497923] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.498236] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.498462] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.498562] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.498750] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.498930] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.498930] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.499705] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.499794] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.500255] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.500358] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.500420] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.500597] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.501677] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.501791] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: da8b2154-7ccc-42b1-bf6b-c7637399d2db is going to be updated. [ 840.527572] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.527713] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.527768] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.527976] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.528133] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.528297] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da8b2154-7ccc-42b1-bf6b-c7637399d2db" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.671219] env[69506]: INFO networking_nsxv3.common.synchronization [req-959f2ee4-bd28-4387-ba1e-06b48a2c2ad9 req-ad6ed187-57d6-4d46-8c5b-1ef0f27d5e39 tempest-ServerRescueNegativeTestJSON-1844285858 tempest-ServerRescueNegativeTestJSON-1844285858-project-member] Enqueued Resource ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 with Priority: HIGHEST for action security_group_members [ 840.671766] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 with Priority: HIGHEST for action security_group_members [ 840.672104] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-76ac020a-e732-4afe-ace5-7bd4b6ea9072 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.672230] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.672300] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.672641] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.672748] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.674389] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.674389] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.674389] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.674389] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.678145] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76ac020a-e732-4afe-ace5-7bd4b6ea9072',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.006062] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e307bb5-2c7b-4260-88ec-90f13f2de5d2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.055527] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-727 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.055527] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-727" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.055527] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-727" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.055527] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-727" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.055527] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.055527] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.055527] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.056610] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.056720] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.057048] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 841.057242] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 841.057434] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 841.057588] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 841.057784] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 841.057960] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 841.058155] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 841.077573] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 841.077771] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 841.077926] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 841.078160] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-727" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.078550] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-fcc3ab85-7a03-40c9-9832-8b10053ecebb taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.078786] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-fcc3ab85-7a03-40c9-9832-8b10053ecebb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.078962] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-fcc3ab85-7a03-40c9-9832-8b10053ecebb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.079362] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-fcc3ab85-7a03-40c9-9832-8b10053ecebb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.079536] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcc3ab85-7a03-40c9-9832-8b10053ecebb',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.177388] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.177607] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.177607] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.177873] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.177978] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.178185] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.178390] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.178390] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.178534] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.178604] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.178660] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 already deleted. [ 841.178739] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.363261] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 in Status: SUCCESS [ 841.363463] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.363660] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.363964] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.364266] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.364612] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.364612] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.364749] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.364787] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.364914] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.365074] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a6908af9-f839-40b2-9ca2-1fd554ee1d78',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.508628] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.508824] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.508927] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.509213] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.509318] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.509423] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e307bb5-2c7b-4260-88ec-90f13f2de5d2 is going to be created. [ 841.543235] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.543392] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.543444] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.543665] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.543827] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.553886] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e307bb5-2c7b-4260-88ec-90f13f2de5d2 in Status: UNINITIALIZED for 2s [ 841.582272] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.582502] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.582645] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.582976] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.583185] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.583389] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port fcc3ab85-7a03-40c9-9832-8b10053ecebb not found, creating... [ 841.583681] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.584020] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.584020] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.584301] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.584680] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.584802] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.585196] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.585196] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.585524] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.585639] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.585823] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: fcc3ab85-7a03-40c9-9832-8b10053ecebb is going to be created. [ 841.606983] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.606983] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.606983] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.606983] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.606983] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.606983] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-fcc3ab85-7a03-40c9-9832-8b10053ecebb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.867660] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a6908af9-f839-40b2-9ca2-1fd554ee1d78',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.299485] env[69506]: INFO networking_nsxv3.common.synchronization [req-959f2ee4-bd28-4387-ba1e-06b48a2c2ad9 req-a37ff1a7-4826-4f59-9b08-e04d6a811e43 service nova] Enqueued Resource ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 with Priority: HIGHEST for action security_group_rules [ 842.299485] env[69506]: INFO networking_nsxv3.common.synchronization [req-959f2ee4-bd28-4387-ba1e-06b48a2c2ad9 req-a37ff1a7-4826-4f59-9b08-e04d6a811e43 service nova] Enqueued Resource ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 with Priority: HIGHEST for action security_group_members [ 842.299485] env[69506]: INFO networking_nsxv3.common.synchronization [req-959f2ee4-bd28-4387-ba1e-06b48a2c2ad9 req-a37ff1a7-4826-4f59-9b08-e04d6a811e43 service nova] Enqueued Resource ID: fcc3ab85-7a03-40c9-9832-8b10053ecebb with Priority: HIGHEST for action port [ 842.299485] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 with Priority: HIGHEST for action security_group_rules [ 842.299485] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 with Priority: HIGHEST for action security_group_members [ 842.299485] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcc3ab85-7a03-40c9-9832-8b10053ecebb with Priority: HIGHEST for action port [ 842.300264] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76ac020a-e732-4afe-ace5-7bd4b6ea9072 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.300635] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.300849] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.301343] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.301549] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76ac020a-e732-4afe-ace5-7bd4b6ea9072',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.303227] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-76ac020a-e732-4afe-ace5-7bd4b6ea9072 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.303484] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.305019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.305019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.305019] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.305019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.305019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.305019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.305019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.305019] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76ac020a-e732-4afe-ace5-7bd4b6ea9072',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.305763] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-fcc3ab85-7a03-40c9-9832-8b10053ecebb taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.306015] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fcc3ab85-7a03-40c9-9832-8b10053ecebb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.306181] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fcc3ab85-7a03-40c9-9832-8b10053ecebb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.306404] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fcc3ab85-7a03-40c9-9832-8b10053ecebb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.306572] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcc3ab85-7a03-40c9-9832-8b10053ecebb',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.369860] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a6908af9-f839-40b2-9ca2-1fd554ee1d78: rpc.has_security_group_logging(os_id): False [ 842.388270] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.388470] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.388557] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.388714] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.388806] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.389150] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.389253] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.389320] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.389480] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.389561] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.389651] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 is going to be updated. [ 842.447874] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.448037] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.448100] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.448285] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.448456] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.460846] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 in Status: IN_PROGRESS for 2s [ 842.809302] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-76ac020a-e732-4afe-ace5-7bd4b6ea9072 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.809302] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.809302] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76ac020a-e732-4afe-ace5-7bd4b6ea9072',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.811946] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fcc3ab85-7a03-40c9-9832-8b10053ecebb with status ACTIVE [ 842.811946] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.811946] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.811946] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.811946] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.811946] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.811946] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.812293] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.812293] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.812643] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.812643] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.812770] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.812978] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.812978] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.813246] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.813375] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.813375] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fcc3ab85-7a03-40c9-9832-8b10053ecebb is going to be updated. [ 842.834911] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.835155] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.835245] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.835458] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.835760] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.835913] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fcc3ab85-7a03-40c9-9832-8b10053ecebb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.315205] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76ac020a-e732-4afe-ace5-7bd4b6ea9072',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.565112] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e307bb5-2c7b-4260-88ec-90f13f2de5d2 in Status: SUCCESS [ 843.565112] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e307bb5-2c7b-4260-88ec-90f13f2de5d2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.565112] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e307bb5-2c7b-4260-88ec-90f13f2de5d2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.565112] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e307bb5-2c7b-4260-88ec-90f13f2de5d2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.565112] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.565112] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.565112] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.565112] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.565112] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.565112] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e307bb5-2c7b-4260-88ec-90f13f2de5d2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.565112] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e307bb5-2c7b-4260-88ec-90f13f2de5d2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.617344] env[69506]: INFO networking_nsxv3.common.synchronization [None req-a28c6956-9cc9-4629-9f10-5b80f4092616 tempest-AttachInterfacesTestJSON-2055467997 tempest-AttachInterfacesTestJSON-2055467997-project-member] Enqueued Resource ID: 2d66cc0b-bd33-47cb-9365-01d39638c887 with Priority: HIGHEST for action security_group_rules [ 843.617344] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d66cc0b-bd33-47cb-9365-01d39638c887 with Priority: HIGHEST for action security_group_rules [ 843.617344] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d66cc0b-bd33-47cb-9365-01d39638c887 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.617344] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d66cc0b-bd33-47cb-9365-01d39638c887" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.617344] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d66cc0b-bd33-47cb-9365-01d39638c887" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.617344] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d66cc0b-bd33-47cb-9365-01d39638c887" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.617344] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d66cc0b-bd33-47cb-9365-01d39638c887',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.752028] env[69506]: INFO networking_nsxv3.common.synchronization [None req-9d64543d-0834-449a-b756-5bc3fdac580f tempest-AttachInterfacesTestJSON-2055467997 tempest-AttachInterfacesTestJSON-2055467997-project-member] Enqueued Resource ID: 2d66cc0b-bd33-47cb-9365-01d39638c887 with Priority: HIGHEST for action security_group_rules [ 843.752028] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d66cc0b-bd33-47cb-9365-01d39638c887 with Priority: HIGHEST for action security_group_rules [ 843.752122] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d66cc0b-bd33-47cb-9365-01d39638c887 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.752198] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d66cc0b-bd33-47cb-9365-01d39638c887" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.817780] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.817959] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.818047] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.818275] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.818369] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.818474] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 is going to be created. [ 843.841357] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.841518] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.841588] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.841810] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.841977] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.850923] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 in Status: UNINITIALIZED for 2s [ 844.068219] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e307bb5-2c7b-4260-88ec-90f13f2de5d2 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.068427] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e307bb5-2c7b-4260-88ec-90f13f2de5d2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.068562] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e307bb5-2c7b-4260-88ec-90f13f2de5d2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.068797] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e307bb5-2c7b-4260-88ec-90f13f2de5d2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.069093] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.069258] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.069376] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.069798] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.070041] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.070259] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e307bb5-2c7b-4260-88ec-90f13f2de5d2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.070546] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e307bb5-2c7b-4260-88ec-90f13f2de5d2 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.070740] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e307bb5-2c7b-4260-88ec-90f13f2de5d2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.070878] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e307bb5-2c7b-4260-88ec-90f13f2de5d2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.071152] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e307bb5-2c7b-4260-88ec-90f13f2de5d2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.071363] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.071533] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.071626] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.071804] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.071937] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.072075] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e307bb5-2c7b-4260-88ec-90f13f2de5d2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.072203] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e307bb5-2c7b-4260-88ec-90f13f2de5d2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.142523] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.142523] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.142523] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.142523] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.142766] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.142766] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d66cc0b-bd33-47cb-9365-01d39638c887 already deleted. [ 844.142766] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d66cc0b-bd33-47cb-9365-01d39638c887" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.142946] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d66cc0b-bd33-47cb-9365-01d39638c887" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.143452] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d66cc0b-bd33-47cb-9365-01d39638c887" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.143452] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d66cc0b-bd33-47cb-9365-01d39638c887',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.474598] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 in Status: SUCCESS [ 844.474598] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.574294] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e307bb5-2c7b-4260-88ec-90f13f2de5d2: rpc.has_security_group_logging(os_id): False [ 844.591870] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.591870] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.591870] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.591870] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.591870] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.592337] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.592337] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.592337] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.592523] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.592622] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.592923] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.593065] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.593136] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.593302] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.593386] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.593582] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.593688] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.593748] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.593897] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.593982] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.594184] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e307bb5-2c7b-4260-88ec-90f13f2de5d2 is going to be created. [ 844.660529] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.660529] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.660529] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.660529] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.660529] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.663063] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.663788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.663788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.663788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.663788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.663788] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d66cc0b-bd33-47cb-9365-01d39638c887 already deleted. [ 844.663788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d66cc0b-bd33-47cb-9365-01d39638c887" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.668985] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e307bb5-2c7b-4260-88ec-90f13f2de5d2 in Status: IN_PROGRESS for 2s [ 845.864019] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 in Status: SUCCESS [ 845.864019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.864019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.864019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.864019] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.864019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.864019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.864019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.864019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.864019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.864019] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('76ac020a-e732-4afe-ace5-7bd4b6ea9072',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.365909] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-76ac020a-e732-4afe-ace5-7bd4b6ea9072 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.366127] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.366184] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.366438] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.366537] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.366635] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.366697] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.366842] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.367039] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.367145] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.367297] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-76ac020a-e732-4afe-ace5-7bd4b6ea9072 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.367389] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.367448] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.367583] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.367736] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.367829] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.367889] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.368057] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.368134] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.368216] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.368687] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('76ac020a-e732-4afe-ace5-7bd4b6ea9072',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.681429] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e307bb5-2c7b-4260-88ec-90f13f2de5d2 in Status: SUCCESS [ 846.681429] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e307bb5-2c7b-4260-88ec-90f13f2de5d2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.871951] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 76ac020a-e732-4afe-ace5-7bd4b6ea9072: rpc.has_security_group_logging(os_id): False [ 846.891244] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.891244] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.891244] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.891244] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.891244] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.891244] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.891244] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.891244] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.891244] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.891244] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.891244] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.891244] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.891244] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.891244] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.891244] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.891991] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.891991] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.891991] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.891991] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.891991] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.891991] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 is going to be created. [ 847.015861] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.016081] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.016203] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.016451] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.016660] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.026726] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 in Status: IN_PROGRESS for 2s [ 848.165627] env[69506]: INFO networking_nsxv3.common.synchronization [req-0c069c7b-9df7-4665-b1f6-80f5809f0492 req-af4de02a-ee4c-4aa2-808f-cafaaca3b816 tempest-ServerRescueNegativeTestJSON-1844285858 tempest-ServerRescueNegativeTestJSON-1844285858-project-member] Enqueued Resource ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 with Priority: HIGHEST for action security_group_members [ 848.165627] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 with Priority: HIGHEST for action security_group_members [ 848.165627] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-76ac020a-e732-4afe-ace5-7bd4b6ea9072 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.165627] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.165627] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.165627] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.166258] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.166501] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.166902] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.166902] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.167199] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.167684] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76ac020a-e732-4afe-ace5-7bd4b6ea9072',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.524927] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-727 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.525139] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-727" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.525265] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-727" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.525543] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-727" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.525803] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.525956] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.526080] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.526285] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.526424] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.526685] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 848.526753] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 848.526859] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 848.526966] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 848.527081] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 848.527185] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 848.527312] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 848.546531] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 848.546703] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 848.546852] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 848.547027] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-727" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.547438] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-f1f7434c-f45f-4110-8098-0d6868bac249 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.547575] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-f1f7434c-f45f-4110-8098-0d6868bac249" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.547688] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-f1f7434c-f45f-4110-8098-0d6868bac249" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.548097] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-f1f7434c-f45f-4110-8098-0d6868bac249" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.548247] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1f7434c-f45f-4110-8098-0d6868bac249',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.672205] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76ac020a-e732-4afe-ace5-7bd4b6ea9072',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.037700] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 in Status: SUCCESS [ 849.037700] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.050845] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.050998] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.051100] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.051439] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.051607] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.051764] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port f1f7434c-f45f-4110-8098-0d6868bac249 not found, creating... [ 849.052028] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.052191] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.052319] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.052539] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.052674] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.052997] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.053179] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.053296] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.053500] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.053632] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.053789] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: f1f7434c-f45f-4110-8098-0d6868bac249 is going to be created. [ 849.073621] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.073955] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.074229] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.074677] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.074983] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.075543] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-f1f7434c-f45f-4110-8098-0d6868bac249" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.174746] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76ac020a-e732-4afe-ace5-7bd4b6ea9072',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.677254] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.677642] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.677802] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.678013] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.678146] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.678251] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 is going to be updated. [ 849.705470] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.705644] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.705716] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.705931] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.706096] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.714921] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 in Status: IN_PROGRESS for 2s [ 850.069303] env[69506]: INFO networking_nsxv3.common.synchronization [req-0c069c7b-9df7-4665-b1f6-80f5809f0492 req-e93b6733-6605-4476-8055-27c04677ed76 service nova] Enqueued Resource ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 with Priority: HIGHEST for action security_group_rules [ 850.069464] env[69506]: INFO networking_nsxv3.common.synchronization [req-0c069c7b-9df7-4665-b1f6-80f5809f0492 req-e93b6733-6605-4476-8055-27c04677ed76 service nova] Enqueued Resource ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 with Priority: HIGHEST for action security_group_members [ 850.069539] env[69506]: INFO networking_nsxv3.common.synchronization [req-0c069c7b-9df7-4665-b1f6-80f5809f0492 req-e93b6733-6605-4476-8055-27c04677ed76 service nova] Enqueued Resource ID: f1f7434c-f45f-4110-8098-0d6868bac249 with Priority: HIGHEST for action port [ 850.070209] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 with Priority: HIGHEST for action security_group_rules [ 850.070322] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 with Priority: HIGHEST for action security_group_members [ 850.070423] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1f7434c-f45f-4110-8098-0d6868bac249 with Priority: HIGHEST for action port [ 850.070769] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76ac020a-e732-4afe-ace5-7bd4b6ea9072 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.070919] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.071025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.071237] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.071334] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76ac020a-e732-4afe-ace5-7bd4b6ea9072',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.072663] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-76ac020a-e732-4afe-ace5-7bd4b6ea9072 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.072663] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.072663] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1f7434c-f45f-4110-8098-0d6868bac249 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.072663] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1f7434c-f45f-4110-8098-0d6868bac249" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.072962] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1f7434c-f45f-4110-8098-0d6868bac249" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.072962] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1f7434c-f45f-4110-8098-0d6868bac249" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.072962] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1f7434c-f45f-4110-8098-0d6868bac249',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.275407] env[69506]: INFO networking_nsxv3.common.synchronization [req-c31526fa-366f-4a28-a919-9d6e4644ab46 req-9d1600ac-dc08-4e82-b456-ee20389feb93 tempest-ServerRescueTestJSON-235851791 tempest-ServerRescueTestJSON-235851791-project-member] Enqueued Resource ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 with Priority: HIGHEST for action security_group_members [ 850.275958] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 with Priority: HIGHEST for action security_group_members [ 850.279854] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-65fb79f7-95e7-4be9-b5bb-64c57bc42333 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.280064] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.280064] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.280279] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.280462] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.280565] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.280627] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.280816] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.280891] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.281043] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65fb79f7-95e7-4be9-b5bb-64c57bc42333',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.575687] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-76ac020a-e732-4afe-ace5-7bd4b6ea9072 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.575844] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.580046] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f1f7434c-f45f-4110-8098-0d6868bac249 with status ACTIVE [ 850.580046] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.580046] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.580046] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.580630] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.580630] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.580630] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.580837] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.580837] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.580939] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.582030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.582135] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.582374] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.582445] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.582605] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.582756] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.582810] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f1f7434c-f45f-4110-8098-0d6868bac249 is going to be updated. [ 850.602019] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.602019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.602019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.602290] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.602290] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.602396] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1f7434c-f45f-4110-8098-0d6868bac249" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.783348] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('65fb79f7-95e7-4be9-b5bb-64c57bc42333',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.286837] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('65fb79f7-95e7-4be9-b5bb-64c57bc42333',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.724135] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 in Status: SUCCESS [ 851.724451] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.724695] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.725011] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.725391] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.725514] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.725558] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.725757] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.725867] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.726033] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76ac020a-e732-4afe-ace5-7bd4b6ea9072',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.790378] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.790831] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.790831] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.790959] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.791759] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.791759] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 is going to be updated. [ 851.815427] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.815597] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.815597] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.815888] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.815924] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.824045] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 in Status: IN_PROGRESS for 2s [ 852.228751] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76ac020a-e732-4afe-ace5-7bd4b6ea9072',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.730741] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76ac020a-e732-4afe-ace5-7bd4b6ea9072',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.235047] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.235047] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.235047] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.235047] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.235047] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.235047] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 is going to be updated. [ 853.265096] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.265096] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.265096] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.265096] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.265096] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.272708] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 in Status: IN_PROGRESS for 2s [ 853.550751] env[69506]: INFO networking_nsxv3.common.synchronization [req-8369444b-f1f7-41d0-8161-13752f005da4 req-54c9437d-8a8c-4de2-8c9d-7d706f7ad4c2 tempest-ImagesTestJSON-821230832 tempest-ImagesTestJSON-821230832-project-member] Enqueued Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_members [ 853.552203] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_members [ 853.552310] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0db323-2ed4-4f6a-a30a-405b16133cb2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.553336] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.553336] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.553336] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.553336] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.553336] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.553336] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.553336] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.554088] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.554240] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.835216] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 in Status: SUCCESS [ 853.835216] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.049536] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-612 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.049734] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-612" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.049865] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-612" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.050189] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-612" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.050458] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.050618] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.050737] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.050961] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.051162] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.051385] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 854.051508] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 854.051620] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 854.051729] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 854.051846] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 854.051954] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 854.052101] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 854.056344] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.056429] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.056476] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.056616] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.074120] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 854.074120] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 854.074120] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 854.074120] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-612" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.074120] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-6d8b89c0-29bd-4310-adf7-b58655c986a5 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.074435] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-6d8b89c0-29bd-4310-adf7-b58655c986a5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.074435] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-6d8b89c0-29bd-4310-adf7-b58655c986a5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.074719] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-6d8b89c0-29bd-4310-adf7-b58655c986a5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.074853] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d8b89c0-29bd-4310-adf7-b58655c986a5',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.078997] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.079239] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.079347] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.079424] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.079581] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.079658] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.079741] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 is going to be updated. [ 854.103172] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.103347] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.103431] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.103654] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.103819] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.113251] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: IN_PROGRESS for 2s [ 854.579840] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.579840] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.579840] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.580239] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.580378] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.580694] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 6d8b89c0-29bd-4310-adf7-b58655c986a5 not found, creating... [ 854.580863] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.581072] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.581215] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.581508] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.581658] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.581976] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.582192] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.582867] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.582867] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.582867] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.583094] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 6d8b89c0-29bd-4310-adf7-b58655c986a5 is going to be created. [ 854.601386] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.601386] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.601668] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.601832] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.602396] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.603037] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-6d8b89c0-29bd-4310-adf7-b58655c986a5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.283743] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 in Status: SUCCESS [ 855.284217] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.284531] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.284885] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.285204] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.285400] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.285513] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.285783] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.285938] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.286153] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.286317] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('76ac020a-e732-4afe-ace5-7bd4b6ea9072',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.421733] env[69506]: INFO networking_nsxv3.common.synchronization [req-8369444b-f1f7-41d0-8161-13752f005da4 req-055f6a25-b1db-4f7e-877a-c53fc5b9d0b4 service nova] Enqueued Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_rules [ 855.421733] env[69506]: INFO networking_nsxv3.common.synchronization [req-8369444b-f1f7-41d0-8161-13752f005da4 req-055f6a25-b1db-4f7e-877a-c53fc5b9d0b4 service nova] Enqueued Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_members [ 855.421733] env[69506]: INFO networking_nsxv3.common.synchronization [req-8369444b-f1f7-41d0-8161-13752f005da4 req-055f6a25-b1db-4f7e-877a-c53fc5b9d0b4 service nova] Enqueued Resource ID: 6d8b89c0-29bd-4310-adf7-b58655c986a5 with Priority: HIGHEST for action port [ 855.421733] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_rules [ 855.421950] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_members [ 855.421950] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d8b89c0-29bd-4310-adf7-b58655c986a5 with Priority: HIGHEST for action port [ 855.422532] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d0db323-2ed4-4f6a-a30a-405b16133cb2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.422637] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.422693] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.422899] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.422978] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.424139] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0db323-2ed4-4f6a-a30a-405b16133cb2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.424139] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.424139] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d8b89c0-29bd-4310-adf7-b58655c986a5 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.427620] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d8b89c0-29bd-4310-adf7-b58655c986a5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.427620] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d8b89c0-29bd-4310-adf7-b58655c986a5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.427620] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d8b89c0-29bd-4310-adf7-b58655c986a5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.427620] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d8b89c0-29bd-4310-adf7-b58655c986a5',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.747935] env[69506]: INFO networking_nsxv3.common.synchronization [req-0bdf6931-6eee-4b00-96eb-2bb89a455b3a req-c6a80177-330b-4b1a-adef-69b20a8af659 tempest-VolumesAdminNegativeTest-1438419906 tempest-VolumesAdminNegativeTest-1438419906-project-member] Enqueued Resource ID: 7e307bb5-2c7b-4260-88ec-90f13f2de5d2 with Priority: HIGHEST for action security_group_members [ 855.747935] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e307bb5-2c7b-4260-88ec-90f13f2de5d2 with Priority: HIGHEST for action security_group_members [ 855.747935] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e307bb5-2c7b-4260-88ec-90f13f2de5d2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.747935] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e307bb5-2c7b-4260-88ec-90f13f2de5d2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.747935] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e307bb5-2c7b-4260-88ec-90f13f2de5d2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.747935] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e307bb5-2c7b-4260-88ec-90f13f2de5d2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.747935] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.748407] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.748407] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.748407] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.748407] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.748572] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e307bb5-2c7b-4260-88ec-90f13f2de5d2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.794897] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-76ac020a-e732-4afe-ace5-7bd4b6ea9072 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.795807] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.795807] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.795807] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.797157] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.797157] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.797157] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.797157] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.797157] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.797157] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.797157] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-76ac020a-e732-4afe-ace5-7bd4b6ea9072 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.797496] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.797496] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.797627] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.797785] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.797892] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.797968] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.798097] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.798162] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.798257] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.798339] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('76ac020a-e732-4afe-ace5-7bd4b6ea9072',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.926417] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0db323-2ed4-4f6a-a30a-405b16133cb2 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.926557] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.930191] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6d8b89c0-29bd-4310-adf7-b58655c986a5 with status ACTIVE [ 855.930276] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.930407] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.930486] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.930685] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.930773] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.930944] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.931055] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.931116] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.931266] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.931358] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.931522] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.931613] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.931670] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.931800] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.931872] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.931957] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6d8b89c0-29bd-4310-adf7-b58655c986a5 is going to be updated. [ 855.953173] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.953375] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.953585] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.953652] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.953890] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.954073] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d8b89c0-29bd-4310-adf7-b58655c986a5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.123756] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: IN_PROGRESS for 4s [ 856.250850] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.251106] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.252175] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.252175] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.252175] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.252175] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.252175] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.252175] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.252488] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.252488] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.252488] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e307bb5-2c7b-4260-88ec-90f13f2de5d2 is going to be updated. [ 856.284330] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.284330] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.284330] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.285047] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.285047] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.302158] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e307bb5-2c7b-4260-88ec-90f13f2de5d2 in Status: IN_PROGRESS for 2s [ 856.302158] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 76ac020a-e732-4afe-ace5-7bd4b6ea9072: rpc.has_security_group_logging(os_id): False [ 856.322077] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.322265] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.322325] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.322544] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.322639] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.322879] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.322940] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.322991] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.323191] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.323268] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.323473] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.323885] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.323885] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.323994] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.324560] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.324789] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.324893] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.324961] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.325121] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.325249] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.325391] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 is going to be updated. [ 856.391178] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.391282] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.391361] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.391572] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.391682] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.406782] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 in Status: IN_PROGRESS for 2s [ 858.135097] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: SUCCESS [ 858.135441] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 deletion is rescheduled due to dependency. [ 858.135441] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.135519] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.135718] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.135903] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.136053] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.136160] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.136369] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.136471] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.136557] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.311022] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e307bb5-2c7b-4260-88ec-90f13f2de5d2 in Status: SUCCESS [ 858.311022] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e307bb5-2c7b-4260-88ec-90f13f2de5d2 deletion is rescheduled due to dependency. [ 858.311022] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e307bb5-2c7b-4260-88ec-90f13f2de5d2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.421090] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 in Status: SUCCESS [ 858.421379] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.640425] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.142771] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.645900] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.646081] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.646147] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.646538] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.646806] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.647737] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 is going to be updated. [ 859.679320] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.679596] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.679711] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.680017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.680248] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.694026] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: IN_PROGRESS for 2s [ 860.747617] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 860.747918] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 861.065686] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.065686] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.065686] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.065686] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.065686] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.568048] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.701841] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: SUCCESS [ 861.702138] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.702336] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.702568] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.702773] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.702909] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.702977] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.703168] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.703255] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.703370] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.703667] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.071216] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.206377] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0db323-2ed4-4f6a-a30a-405b16133cb2 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.206573] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.206610] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.206831] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.207566] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.207566] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.207566] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.207566] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.207566] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.207566] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.207978] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0db323-2ed4-4f6a-a30a-405b16133cb2 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.207978] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.207978] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.207978] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.208127] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.208127] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.208207] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.208332] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.208387] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.208461] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.208553] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.572902] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 862.572959] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 862.710895] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d0db323-2ed4-4f6a-a30a-405b16133cb2: rpc.has_security_group_logging(os_id): False [ 862.729628] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.729857] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.729857] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.730139] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.730250] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.730472] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.730600] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.730659] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.730799] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.730870] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.731126] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.731228] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.731286] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.731438] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.731518] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.731726] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.731827] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.731873] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.732819] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.733035] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.733183] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 is going to be updated. [ 862.788991] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.789283] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.789391] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.789547] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.789726] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.802320] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: IN_PROGRESS for 2s [ 863.330100] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.330580] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.330580] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.330580] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.344902] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 863.346012] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.347247] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 863.373910] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.374203] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.374280] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.374611] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.384230] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.384814] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 863.384931] env[69506]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69506) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 863.385050] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 863.425146] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.425371] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.425441] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.425676] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.426756] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.426923] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 863.499762] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.499969] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.499969] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.500305] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.500549] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.500819] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 863.571556] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.571728] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.571773] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.572039] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.572269] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.572506] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:38. [ 863.572601] env[69506]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'45d4afae-b465-436c-9353-5ec36cb81429', '1bceaf9d-1c44-4281-83d2-4109ac0771c7', '7d665e3e-5768-414e-b88d-89e23ff633e1', '753050ac-8ed4-4825-8136-44279adacb0f', '9ba7662d-ea93-4828-a093-1d0b8a8fc40f', '2517f7a1-fddd-463b-9fe1-c71acfb13743', '77834f91-37e7-4feb-86e1-583e68d3d852', '05c6d62a-58f1-418b-815e-8b3f7f5cd5eb', '386ab661-7bf3-4005-884c-cf906d5c497b', 'a6908af9-f839-40b2-9ca2-1fd554ee1d78', 'c6cf0f63-443c-4fdc-9d02-4df041c1ea64', 'd1fc353c-0404-4f16-bed0-42c4e9a557a3', 'a149f18b-817c-45ab-98f1-e5cc2ba7f60d', '76ac020a-e732-4afe-ace5-7bd4b6ea9072', '56702d6b-7f85-46e1-bf9f-c5bba683fb41', '706a5462-e893-428d-beb2-737cbec00439', '96b2c90a-a7a0-4dcb-8212-5e459d8d4793', 'c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5', '74c7c33d-c19d-4ab6-af56-0941c2240118', '66b9350a-2732-4479-ad5a-cb47a49072f7', '0a27cb9c-bb13-44cb-a531-49610a94a36e', '64557eb9-9b83-42ab-99e4-278f5711a22e', '5387ebf9-b56f-4308-969a-3aa715cad9da', 'fca9cd47-c1fb-4023-8f12-fa1b22a98fd8', '78caaaf6-868f-4043-93dd-d9a75a05d023', '3f946d66-543a-40be-9347-81d7eb4f4e31', '7e307bb5-2c7b-4260-88ec-90f13f2de5d2', '7d0db323-2ed4-4f6a-a30a-405b16133cb2', '823c6679-501c-4ec2-9d9f-f49b7cc1205d', '40ac1d9f-7f09-4603-ba34-b3f5910e1da2', '008501d4-938b-4336-9c1d-ef3665f7d09d', '65fb79f7-95e7-4be9-b5bb-64c57bc42333', '56c2fe94-2993-4f31-a331-b0611a88cec2', '9ce980c1-0c92-48ab-930f-2537a5f82269', '9f130eeb-c453-4570-b0fe-743f47890102', '9e830a1e-918a-49a7-b725-f68307282e6e', '39f6b94d-d05c-4309-8b06-e27ba3215b09', '0745f36a-3469-4c49-9c0f-8111fe1bd802'} {{(pid=69506) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 863.572691] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 863.591976] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.592203] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.592203] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.592433] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.592523] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.592640] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 863.592711] env[69506]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69506) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 863.592784] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 863.665684] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.666267] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.666267] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.666267] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.666901] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.667154] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 863.667228] env[69506]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69506) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 863.667330] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 863.667459] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 863.667529] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/38 resources of Type:Security Group Rules [ 863.667590] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 45d4afae-b465-436c-9353-5ec36cb81429 with Priority: HIGH for action security_group_rules [ 863.667643] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1bceaf9d-1c44-4281-83d2-4109ac0771c7 with Priority: HIGH for action security_group_rules [ 863.667764] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7d665e3e-5768-414e-b88d-89e23ff633e1 with Priority: HIGH for action security_group_rules [ 863.667816] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 753050ac-8ed4-4825-8136-44279adacb0f with Priority: HIGH for action security_group_rules [ 863.667859] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9ba7662d-ea93-4828-a093-1d0b8a8fc40f with Priority: HIGH for action security_group_rules [ 863.667891] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2517f7a1-fddd-463b-9fe1-c71acfb13743 with Priority: HIGH for action security_group_rules [ 863.668052] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 77834f91-37e7-4feb-86e1-583e68d3d852 with Priority: HIGH for action security_group_rules [ 863.668052] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 05c6d62a-58f1-418b-815e-8b3f7f5cd5eb with Priority: HIGH for action security_group_rules [ 863.668197] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 386ab661-7bf3-4005-884c-cf906d5c497b with Priority: HIGH for action security_group_rules [ 863.668197] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 with Priority: HIGH for action security_group_rules [ 863.668197] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c6cf0f63-443c-4fdc-9d02-4df041c1ea64 with Priority: HIGH for action security_group_rules [ 863.668552] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d1fc353c-0404-4f16-bed0-42c4e9a557a3 with Priority: HIGH for action security_group_rules [ 863.668552] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a149f18b-817c-45ab-98f1-e5cc2ba7f60d with Priority: HIGH for action security_group_rules [ 863.668552] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 with Priority: HIGH for action security_group_rules [ 863.668552] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 56702d6b-7f85-46e1-bf9f-c5bba683fb41 with Priority: HIGH for action security_group_rules [ 863.668552] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 706a5462-e893-428d-beb2-737cbec00439 with Priority: HIGH for action security_group_rules [ 863.668552] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 with Priority: HIGH for action security_group_rules [ 863.668832] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 with Priority: HIGH for action security_group_rules [ 863.668832] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 with Priority: HIGH for action security_group_rules [ 863.668832] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 66b9350a-2732-4479-ad5a-cb47a49072f7 with Priority: HIGH for action security_group_rules [ 863.668952] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.814756] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: SUCCESS [ 864.815057] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.748718] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 865.748884] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 865.749146] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45d4afae-b465-436c-9353-5ec36cb81429 with Priority: HIGH for action security_group_rules [ 865.749460] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d665e3e-5768-414e-b88d-89e23ff633e1 with Priority: HIGH for action security_group_rules [ 865.749460] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77834f91-37e7-4feb-86e1-583e68d3d852 with Priority: HIGH for action security_group_rules [ 865.749630] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56702d6b-7f85-46e1-bf9f-c5bba683fb41 with Priority: HIGH for action security_group_rules [ 865.749689] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66b9350a-2732-4479-ad5a-cb47a49072f7 with Priority: HIGH for action security_group_rules [ 865.749794] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 with Priority: HIGH for action security_group_rules [ 865.749871] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 with Priority: HIGH for action security_group_rules [ 865.749909] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 with Priority: HIGH for action security_group_rules [ 865.750049] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 with Priority: HIGH for action security_group_rules [ 865.750200] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 706a5462-e893-428d-beb2-737cbec00439 with Priority: HIGH for action security_group_rules [ 865.750279] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a149f18b-817c-45ab-98f1-e5cc2ba7f60d with Priority: HIGH for action security_group_rules [ 865.750347] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1fc353c-0404-4f16-bed0-42c4e9a557a3 with Priority: HIGH for action security_group_rules [ 865.750429] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6cf0f63-443c-4fdc-9d02-4df041c1ea64 with Priority: HIGH for action security_group_rules [ 865.750522] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 with Priority: HIGH for action security_group_rules [ 865.750611] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 386ab661-7bf3-4005-884c-cf906d5c497b with Priority: HIGH for action security_group_rules [ 865.750700] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2517f7a1-fddd-463b-9fe1-c71acfb13743 with Priority: HIGH for action security_group_rules [ 865.750789] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05c6d62a-58f1-418b-815e-8b3f7f5cd5eb with Priority: HIGH for action security_group_rules [ 865.750878] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ba7662d-ea93-4828-a093-1d0b8a8fc40f with Priority: HIGH for action security_group_rules [ 865.751073] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bceaf9d-1c44-4281-83d2-4109ac0771c7 with Priority: HIGH for action security_group_rules [ 865.751073] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 753050ac-8ed4-4825-8136-44279adacb0f with Priority: HIGH for action security_group_rules [ 865.751399] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45d4afae-b465-436c-9353-5ec36cb81429 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.751629] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45d4afae-b465-436c-9353-5ec36cb81429" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.751629] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45d4afae-b465-436c-9353-5ec36cb81429" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.751824] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45d4afae-b465-436c-9353-5ec36cb81429" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.751929] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45d4afae-b465-436c-9353-5ec36cb81429',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.753171] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d665e3e-5768-414e-b88d-89e23ff633e1 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.753321] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d665e3e-5768-414e-b88d-89e23ff633e1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.753374] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d665e3e-5768-414e-b88d-89e23ff633e1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.753551] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d665e3e-5768-414e-b88d-89e23ff633e1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.753626] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d665e3e-5768-414e-b88d-89e23ff633e1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.754447] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77834f91-37e7-4feb-86e1-583e68d3d852 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.754577] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.754648] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.754835] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.754909] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77834f91-37e7-4feb-86e1-583e68d3d852',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.756106] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-56702d6b-7f85-46e1-bf9f-c5bba683fb41 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.756227] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-56702d6b-7f85-46e1-bf9f-c5bba683fb41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.756309] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-56702d6b-7f85-46e1-bf9f-c5bba683fb41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.756950] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-56702d6b-7f85-46e1-bf9f-c5bba683fb41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.756950] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('56702d6b-7f85-46e1-bf9f-c5bba683fb41',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.757355] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66b9350a-2732-4479-ad5a-cb47a49072f7 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.757355] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66b9350a-2732-4479-ad5a-cb47a49072f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.757474] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66b9350a-2732-4479-ad5a-cb47a49072f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.757512] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66b9350a-2732-4479-ad5a-cb47a49072f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.758092] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66b9350a-2732-4479-ad5a-cb47a49072f7',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.758641] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-74c7c33d-c19d-4ab6-af56-0941c2240118 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.758762] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.758836] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.758950] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.759092] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('74c7c33d-c19d-4ab6-af56-0941c2240118',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.760209] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.760209] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.760209] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.760470] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.760470] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.761823] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.761888] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.761966] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.762271] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.762271] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('96b2c90a-a7a0-4dcb-8212-5e459d8d4793',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.763104] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76ac020a-e732-4afe-ace5-7bd4b6ea9072 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.763210] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.763268] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.763409] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.763480] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76ac020a-e732-4afe-ace5-7bd4b6ea9072',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.764325] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-706a5462-e893-428d-beb2-737cbec00439 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.764418] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.764490] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.764655] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.764726] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.766680] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a149f18b-817c-45ab-98f1-e5cc2ba7f60d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.766809] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a149f18b-817c-45ab-98f1-e5cc2ba7f60d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.766872] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a149f18b-817c-45ab-98f1-e5cc2ba7f60d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.768037] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a149f18b-817c-45ab-98f1-e5cc2ba7f60d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.768037] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a149f18b-817c-45ab-98f1-e5cc2ba7f60d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.768037] env[69506]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 865.768037] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1fc353c-0404-4f16-bed0-42c4e9a557a3 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.768265] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1fc353c-0404-4f16-bed0-42c4e9a557a3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.768265] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1fc353c-0404-4f16-bed0-42c4e9a557a3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.768265] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1fc353c-0404-4f16-bed0-42c4e9a557a3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.768384] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1fc353c-0404-4f16-bed0-42c4e9a557a3',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.769199] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6cf0f63-443c-4fdc-9d02-4df041c1ea64 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.769306] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6cf0f63-443c-4fdc-9d02-4df041c1ea64" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.769390] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6cf0f63-443c-4fdc-9d02-4df041c1ea64" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.769535] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6cf0f63-443c-4fdc-9d02-4df041c1ea64" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.769607] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6cf0f63-443c-4fdc-9d02-4df041c1ea64',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.770539] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6908af9-f839-40b2-9ca2-1fd554ee1d78 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.770643] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.770709] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.770852] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.770924] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6908af9-f839-40b2-9ca2-1fd554ee1d78',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.771715] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-386ab661-7bf3-4005-884c-cf906d5c497b taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.771813] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-386ab661-7bf3-4005-884c-cf906d5c497b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.771879] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-386ab661-7bf3-4005-884c-cf906d5c497b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.772055] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-386ab661-7bf3-4005-884c-cf906d5c497b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.772131] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('386ab661-7bf3-4005-884c-cf906d5c497b',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.772930] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2517f7a1-fddd-463b-9fe1-c71acfb13743 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.773058] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.773130] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.773292] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.773375] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2517f7a1-fddd-463b-9fe1-c71acfb13743',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.774235] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.774355] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.774422] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.774591] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.774663] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05c6d62a-58f1-418b-815e-8b3f7f5cd5eb',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.775585] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ba7662d-ea93-4828-a093-1d0b8a8fc40f taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.775761] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ba7662d-ea93-4828-a093-1d0b8a8fc40f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.775761] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ba7662d-ea93-4828-a093-1d0b8a8fc40f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.775912] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ba7662d-ea93-4828-a093-1d0b8a8fc40f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.775977] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ba7662d-ea93-4828-a093-1d0b8a8fc40f',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.776811] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bceaf9d-1c44-4281-83d2-4109ac0771c7 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.776916] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.776972] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.777144] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.777212] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bceaf9d-1c44-4281-83d2-4109ac0771c7',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.778065] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-753050ac-8ed4-4825-8136-44279adacb0f taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.778123] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-753050ac-8ed4-4825-8136-44279adacb0f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.778186] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-753050ac-8ed4-4825-8136-44279adacb0f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.778332] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-753050ac-8ed4-4825-8136-44279adacb0f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.778406] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('753050ac-8ed4-4825-8136-44279adacb0f',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.281403] env[69506]: INFO networking_nsxv3.common.synchronization [req-059f4ca5-e77a-4ee3-a422-1a8f53064aad req-98fec389-2375-45f6-8c93-02adc35f452c tempest-ServersAdminTestJSON-446545879 tempest-ServersAdminTestJSON-446545879-project-member] Enqueued Resource ID: 706a5462-e893-428d-beb2-737cbec00439 with Priority: HIGHEST for action security_group_members [ 866.281915] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 706a5462-e893-428d-beb2-737cbec00439 with Priority: HIGHEST for action security_group_members [ 866.283149] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-706a5462-e893-428d-beb2-737cbec00439 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.283294] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.283388] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.283996] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.284284] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.284486] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.284675] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.284796] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.284855] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.284915] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.286684] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-77834f91-37e7-4feb-86e1-583e68d3d852 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.287084] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.287084] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.287084] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.287318] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.287413] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.287413] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.287946] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.287946] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.287946] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.287946] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('77834f91-37e7-4feb-86e1-583e68d3d852',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.312935] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.312935] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.312935] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.312935] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.314377] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.314488] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.318633] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.318633] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.341921] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.342170] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d665e3e-5768-414e-b88d-89e23ff633e1 is going to be deleted. [ 866.343326] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.343482] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.364884] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.365027] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45d4afae-b465-436c-9353-5ec36cb81429 is going to be deleted. [ 866.365931] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.366165] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.385465] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.385600] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 56702d6b-7f85-46e1-bf9f-c5bba683fb41 is going to be deleted. [ 866.404692] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.404692] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.404692] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.404692] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.404692] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.404692] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d665e3e-5768-414e-b88d-89e23ff633e1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.424069] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.424069] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.424069] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.424069] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.424069] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.424069] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45d4afae-b465-436c-9353-5ec36cb81429" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.440550] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.440681] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.440681] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.440866] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.440976] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.441084] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-56702d6b-7f85-46e1-bf9f-c5bba683fb41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.450216] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.450384] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.450485] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.450690] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.451053] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.451170] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.451246] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.451459] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.451560] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.451644] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.451755] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('05c6d62a-58f1-418b-815e-8b3f7f5cd5eb',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.454582] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-706a5462-e893-428d-beb2-737cbec00439 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.454722] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.459118] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-753050ac-8ed4-4825-8136-44279adacb0f taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.459302] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-753050ac-8ed4-4825-8136-44279adacb0f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.459419] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-753050ac-8ed4-4825-8136-44279adacb0f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.459667] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-753050ac-8ed4-4825-8136-44279adacb0f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.459879] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.460028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.460116] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.460296] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.460407] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.460517] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-753050ac-8ed4-4825-8136-44279adacb0f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.460630] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('753050ac-8ed4-4825-8136-44279adacb0f',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.462882] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.463059] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.463133] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.463587] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.463587] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.463770] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.463770] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.463896] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.463995] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.464129] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.464252] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('96b2c90a-a7a0-4dcb-8212-5e459d8d4793',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.471091] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-76ac020a-e732-4afe-ace5-7bd4b6ea9072 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.471253] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.471371] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.471805] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.471870] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.471997] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.472076] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.472263] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.472449] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.472507] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.472581] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('76ac020a-e732-4afe-ace5-7bd4b6ea9072',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.476711] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bceaf9d-1c44-4281-83d2-4109ac0771c7 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.476853] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.476940] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.477190] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.478152] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.478323] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.478323] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.478456] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.478573] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.478683] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.478801] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1bceaf9d-1c44-4281-83d2-4109ac0771c7',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.479899] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6908af9-f839-40b2-9ca2-1fd554ee1d78 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.480058] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.480144] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.480330] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.480520] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.480642] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.480727] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.480910] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.481034] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.481143] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.481252] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a6908af9-f839-40b2-9ca2-1fd554ee1d78',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.492396] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('96b2c90a-a7a0-4dcb-8212-5e459d8d4793',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.495728] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.495728] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.495728] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.495993] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.503935] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 96b2c90a-a7a0-4dcb-8212-5e459d8d4793: rpc.has_security_group_logging(os_id): False [ 866.506095] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a6908af9-f839-40b2-9ca2-1fd554ee1d78',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.590617] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.590803] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.591617] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.591758] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.592751] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.592844] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.593620] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.593713] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.594453] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.594546] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.595203] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.595413] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.600377] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.600486] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.601405] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.601606] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.606944] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.606944] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.628961] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.628961] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a149f18b-817c-45ab-98f1-e5cc2ba7f60d is going to be deleted. [ 866.629672] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.630304] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.674541] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.675472] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.675472] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.675472] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.675472] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.675472] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.676249] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 is going to be updated. [ 866.676735] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.676943] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.744716] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.744850] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5 is going to be deleted. [ 866.745964] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.746248] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.754685] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.754811] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.784771] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.784771] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66b9350a-2732-4479-ad5a-cb47a49072f7 is going to be deleted. [ 866.786723] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.786723] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.793264] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.793975] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('77834f91-37e7-4feb-86e1-583e68d3d852',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.835144] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.836851] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1fc353c-0404-4f16-bed0-42c4e9a557a3 is going to be deleted. [ 866.836851] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.836851] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.860941] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.861159] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.863976] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.864180] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.914936] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.915109] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 74c7c33d-c19d-4ab6-af56-0941c2240118 is going to be deleted. [ 866.916075] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.916333] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.954800] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.954800] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.954800] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.954800] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.955165] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.955165] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.955165] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.955735] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.955735] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.955735] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.955735] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.956041] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.956041] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.956041] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.956155] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.956250] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.956322] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.956463] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.956550] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.956798] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.956798] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('05c6d62a-58f1-418b-815e-8b3f7f5cd5eb',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.960024] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.960388] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.976137] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.976323] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 386ab661-7bf3-4005-884c-cf906d5c497b is going to be deleted. [ 866.977500] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.977812] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.983074] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1bceaf9d-1c44-4281-83d2-4109ac0771c7',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.985940] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('753050ac-8ed4-4825-8136-44279adacb0f',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.997773] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-76ac020a-e732-4afe-ace5-7bd4b6ea9072 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.997916] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.997982] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.998210] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.998393] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.998495] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.998560] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.998708] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.998792] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.999229] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.999393] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-76ac020a-e732-4afe-ace5-7bd4b6ea9072 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.999393] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.999475] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.999573] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.999723] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.999814] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.999872] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.000018] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.000613] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.000733] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.000934] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('76ac020a-e732-4afe-ace5-7bd4b6ea9072',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.007426] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.007426] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.014438] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a6908af9-f839-40b2-9ca2-1fd554ee1d78: rpc.has_security_group_logging(os_id): False [ 867.049672] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.049869] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2517f7a1-fddd-463b-9fe1-c71acfb13743 is going to be deleted. [ 867.051259] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.051487] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.058188] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.058373] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.093337] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.093337] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.105220] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.105220] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ba7662d-ea93-4828-a093-1d0b8a8fc40f is going to be deleted. [ 867.105220] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.105220] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.218059] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.218200] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.238820] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.239028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.258065] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.258295] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6cf0f63-443c-4fdc-9d02-4df041c1ea64 is going to be deleted. [ 867.259364] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.259678] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.259784] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.259878] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a149f18b-817c-45ab-98f1-e5cc2ba7f60d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.260075] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.260282] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.260377] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.260516] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7fdedc1-84f5-44cb-b48d-ae60bdcfdea5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.261045] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.261611] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.261611] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.264592] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.264592] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.264592] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.264592] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66b9350a-2732-4479-ad5a-cb47a49072f7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.264592] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.264592] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.264592] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.264592] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1fc353c-0404-4f16-bed0-42c4e9a557a3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.264592] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.264592] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.295990] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 77834f91-37e7-4feb-86e1-583e68d3d852: rpc.has_security_group_logging(os_id): False [ 867.297526] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.324175] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 in Status: IN_PROGRESS for 2s [ 867.339484] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.339484] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.339484] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.339484] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.339484] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.339484] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.339484] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 is going to be updated. [ 867.340043] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.340043] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.340043] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.340204] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-74c7c33d-c19d-4ab6-af56-0941c2240118" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.340259] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.341552] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.341552] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.341552] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2517f7a1-fddd-463b-9fe1-c71acfb13743" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.341888] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.341888] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.341888] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.342062] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-386ab661-7bf3-4005-884c-cf906d5c497b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.346802] env[69506]: INFO networking_nsxv3.common.synchronization [req-f0067acc-1351-4cc9-8c97-fbedcdd2f7ee req-447d45f1-bf98-4624-93cb-0a2dab670df3 tempest-ImagesNegativeTestJSON-8871123 tempest-ImagesNegativeTestJSON-8871123-project-member] Enqueued Resource ID: b50d66d8-0bc1-42fe-b025-b6e5287fc3df with Priority: HIGHEST for action security_group_members [ 867.346802] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b50d66d8-0bc1-42fe-b025-b6e5287fc3df with Priority: HIGHEST for action security_group_members [ 867.346802] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-b50d66d8-0bc1-42fe-b025-b6e5287fc3df taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.346802] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b50d66d8-0bc1-42fe-b025-b6e5287fc3df" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.346802] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b50d66d8-0bc1-42fe-b025-b6e5287fc3df" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.346802] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b50d66d8-0bc1-42fe-b025-b6e5287fc3df" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.346802] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.346802] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.346802] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.346802] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.347508] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.347508] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b50d66d8-0bc1-42fe-b025-b6e5287fc3df',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.392779] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.392868] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.392943] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.393202] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.422307] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.422307] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.427926] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.427926] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.450528] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.450686] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.450829] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.450920] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.451193] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.451303] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.451433] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77834f91-37e7-4feb-86e1-583e68d3d852 is going to be updated. [ 867.453702] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.454839] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.454940] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.455070] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6cf0f63-443c-4fdc-9d02-4df041c1ea64" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.455209] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.455372] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.455459] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.455555] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ba7662d-ea93-4828-a093-1d0b8a8fc40f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.461515] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 05c6d62a-58f1-418b-815e-8b3f7f5cd5eb: rpc.has_security_group_logging(os_id): False [ 867.472819] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.472819] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.472930] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.473095] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.473906] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.485554] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1bceaf9d-1c44-4281-83d2-4109ac0771c7: rpc.has_security_group_logging(os_id): False [ 867.488348] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 753050ac-8ed4-4825-8136-44279adacb0f: rpc.has_security_group_logging(os_id): False [ 867.500682] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.500838] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.500897] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.501126] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.502487] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 76ac020a-e732-4afe-ace5-7bd4b6ea9072: rpc.has_security_group_logging(os_id): False [ 867.522774] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 in Status: IN_PROGRESS for 2s [ 867.548053] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.548195] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.550676] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.550788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.551598] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.551690] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.573709] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.573868] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.573995] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.574766] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.574994] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.575105] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.575355] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.575465] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.575555] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.575682] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.575758] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.575951] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.576041] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.576106] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.576243] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.576316] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.576411] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05c6d62a-58f1-418b-815e-8b3f7f5cd5eb is going to be updated. [ 867.578113] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.578290] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.598358] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.598653] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.598757] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.598825] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.599057] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.599223] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.599272] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 753050ac-8ed4-4825-8136-44279adacb0f is going to be updated. [ 867.600353] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.600531] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.636371] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.636692] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.636824] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.636894] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.637122] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.637209] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.637411] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.637510] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.637571] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.637716] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.637788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.637978] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.638068] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.638129] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.638317] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.638425] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.638509] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 is going to be updated. [ 867.639691] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.639855] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.641442] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.641528] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.661484] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.661825] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.661976] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.661976] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.662491] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.662591] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.662689] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bceaf9d-1c44-4281-83d2-4109ac0771c7 is going to be updated. [ 867.663835] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.664016] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.664158] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.689606] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.689817] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.689817] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.690022] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.690175] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.694051] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77834f91-37e7-4feb-86e1-583e68d3d852 in Status: IN_PROGRESS for 2s [ 867.718124] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.718279] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.718343] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.718555] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.718691] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.732436] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-451 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.732639] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-451" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.732766] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-451" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.733130] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-451" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.733399] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.733561] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.733695] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.733927] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.734093] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.734309] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 867.734423] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 867.734532] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 867.734649] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 867.734750] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 867.734856] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 867.734996] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 867.736830] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05c6d62a-58f1-418b-815e-8b3f7f5cd5eb in Status: IN_PROGRESS for 2s [ 867.737895] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.738021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.738120] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.738296] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.738434] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.739862] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 753050ac-8ed4-4825-8136-44279adacb0f in Status: IN_PROGRESS for 2s [ 867.788743] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 867.789582] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.054 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 867.789582] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 867.789582] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-451" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.789834] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-d5f0b30b-3d64-477a-b878-be6cb2902135 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.789952] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-d5f0b30b-3d64-477a-b878-be6cb2902135" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.790143] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-d5f0b30b-3d64-477a-b878-be6cb2902135" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.790421] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-d5f0b30b-3d64-477a-b878-be6cb2902135" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.790558] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5f0b30b-3d64-477a-b878-be6cb2902135',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.793698] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.793846] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.793977] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.794096] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.794241] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.797925] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 in Status: IN_PROGRESS for 2s [ 867.800470] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.800630] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.800701] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.800895] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.800989] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.801341] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 706a5462-e893-428d-beb2-737cbec00439 is going to be updated. [ 867.840782] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bceaf9d-1c44-4281-83d2-4109ac0771c7 in Status: IN_PROGRESS for 2s [ 867.852038] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.852038] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.852038] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.852311] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.852416] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.852671] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.852828] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.852934] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.853155] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.853242] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.853356] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b50d66d8-0bc1-42fe-b025-b6e5287fc3df already deleted. [ 867.853463] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b50d66d8-0bc1-42fe-b025-b6e5287fc3df" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.899889] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.900083] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.900133] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.900341] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.900489] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.918091] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 706a5462-e893-428d-beb2-737cbec00439 in Status: IN_PROGRESS for 2s [ 868.293263] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.293460] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.293460] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.293723] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.293877] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.294058] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port d5f0b30b-3d64-477a-b878-be6cb2902135 not found, creating... [ 868.294343] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.294499] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.294616] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.294853] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.295717] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.295717] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.295717] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.295717] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.295717] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.295934] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.296055] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: d5f0b30b-3d64-477a-b878-be6cb2902135 is going to be created. [ 868.317551] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.318696] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.318696] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.318696] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.318696] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.318696] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-d5f0b30b-3d64-477a-b878-be6cb2902135" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.072647] env[69506]: INFO networking_nsxv3.common.synchronization [req-aeee6932-dedb-4d50-86de-b1bd90da2500 req-c7f938af-a8f4-4f20-8c1f-6f76712f2196 tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: 64557eb9-9b83-42ab-99e4-278f5711a22e with Priority: HIGHEST for action security_group_members [ 869.073608] env[69506]: INFO networking_nsxv3.common.synchronization [req-aeee6932-dedb-4d50-86de-b1bd90da2500 req-c7f938af-a8f4-4f20-8c1f-6f76712f2196 tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_members [ 869.073608] env[69506]: INFO networking_nsxv3.common.synchronization [req-aeee6932-dedb-4d50-86de-b1bd90da2500 req-c7f938af-a8f4-4f20-8c1f-6f76712f2196 tempest-SecurityGroupsTestJSON-231780078 tempest-SecurityGroupsTestJSON-231780078-project-member] Enqueued Resource ID: 753050ac-8ed4-4825-8136-44279adacb0f with Priority: HIGHEST for action security_group_members [ 869.073883] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64557eb9-9b83-42ab-99e4-278f5711a22e with Priority: HIGHEST for action security_group_members [ 869.082020] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGHEST for action security_group_members [ 869.082020] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 753050ac-8ed4-4825-8136-44279adacb0f with Priority: HIGHEST for action security_group_members [ 869.082020] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-64557eb9-9b83-42ab-99e4-278f5711a22e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.082020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.082020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.082020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.082020] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.082020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.082020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.082020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.082020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.082020] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64557eb9-9b83-42ab-99e4-278f5711a22e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.082020] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a27cb9c-bb13-44cb-a531-49610a94a36e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.082020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.082020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.083025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.083276] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.083720] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.083881] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.084135] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.084333] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.084514] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.085352] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-753050ac-8ed4-4825-8136-44279adacb0f taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.085635] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-753050ac-8ed4-4825-8136-44279adacb0f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.085816] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-753050ac-8ed4-4825-8136-44279adacb0f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.086077] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-753050ac-8ed4-4825-8136-44279adacb0f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.086402] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.086591] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.086748] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.086988] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.087437] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.092457] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('753050ac-8ed4-4825-8136-44279adacb0f',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.097180] env[69506]: INFO networking_nsxv3.common.synchronization [req-f0067acc-1351-4cc9-8c97-fbedcdd2f7ee req-69068158-23d8-450f-aa70-a1a47595b1e5 service nova] Enqueued Resource ID: b50d66d8-0bc1-42fe-b025-b6e5287fc3df with Priority: HIGHEST for action security_group_rules [ 869.097408] env[69506]: INFO networking_nsxv3.common.synchronization [req-f0067acc-1351-4cc9-8c97-fbedcdd2f7ee req-69068158-23d8-450f-aa70-a1a47595b1e5 service nova] Enqueued Resource ID: b50d66d8-0bc1-42fe-b025-b6e5287fc3df with Priority: HIGHEST for action security_group_members [ 869.097603] env[69506]: INFO networking_nsxv3.common.synchronization [req-f0067acc-1351-4cc9-8c97-fbedcdd2f7ee req-69068158-23d8-450f-aa70-a1a47595b1e5 service nova] Enqueued Resource ID: d5f0b30b-3d64-477a-b878-be6cb2902135 with Priority: HIGHEST for action port [ 869.100720] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.100720] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.100720] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.100720] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.101291] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.101388] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.102055] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b50d66d8-0bc1-42fe-b025-b6e5287fc3df with Priority: HIGHEST for action security_group_rules [ 869.102154] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b50d66d8-0bc1-42fe-b025-b6e5287fc3df with Priority: HIGHEST for action security_group_members [ 869.102261] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5f0b30b-3d64-477a-b878-be6cb2902135 with Priority: HIGHEST for action port [ 869.103660] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b50d66d8-0bc1-42fe-b025-b6e5287fc3df taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.103766] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b50d66d8-0bc1-42fe-b025-b6e5287fc3df" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.103830] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b50d66d8-0bc1-42fe-b025-b6e5287fc3df" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.104356] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b50d66d8-0bc1-42fe-b025-b6e5287fc3df" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.104356] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b50d66d8-0bc1-42fe-b025-b6e5287fc3df',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.105197] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-b50d66d8-0bc1-42fe-b025-b6e5287fc3df taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.105462] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b50d66d8-0bc1-42fe-b025-b6e5287fc3df" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.105546] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b50d66d8-0bc1-42fe-b025-b6e5287fc3df" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.105705] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b50d66d8-0bc1-42fe-b025-b6e5287fc3df" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.105846] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.105940] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.105993] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.106180] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.106266] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.106349] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b50d66d8-0bc1-42fe-b025-b6e5287fc3df',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.107464] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5f0b30b-3d64-477a-b878-be6cb2902135 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.107574] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5f0b30b-3d64-477a-b878-be6cb2902135" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.107574] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5f0b30b-3d64-477a-b878-be6cb2902135" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.107713] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5f0b30b-3d64-477a-b878-be6cb2902135" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.107791] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5f0b30b-3d64-477a-b878-be6cb2902135',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.126061] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.126306] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.126471] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.126508] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.126658] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.126743] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.126834] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64557eb9-9b83-42ab-99e4-278f5711a22e is going to be updated. [ 869.128230] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.128230] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.146985] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.147384] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.147495] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.147495] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.147652] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.147726] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.147814] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e is going to be updated. [ 869.231728] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.231861] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.231905] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.232185] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.232401] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.248025] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64557eb9-9b83-42ab-99e4-278f5711a22e in Status: IN_PROGRESS for 2s [ 869.251557] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.251735] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.251776] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.251971] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.252119] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.260615] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e in Status: IN_PROGRESS for 2s [ 869.352723] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 in Status: SUCCESS [ 869.353028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.540028] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 in Status: SUCCESS [ 869.540028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.598944] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.599211] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.599288] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.599511] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.599889] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.599889] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.599889] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.600106] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.600106] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.600203] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.600272] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 753050ac-8ed4-4825-8136-44279adacb0f is going to be updated. [ 869.611141] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-b50d66d8-0bc1-42fe-b025-b6e5287fc3df taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.611141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b50d66d8-0bc1-42fe-b025-b6e5287fc3df" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.611141] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b50d66d8-0bc1-42fe-b025-b6e5287fc3df',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.612824] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d5f0b30b-3d64-477a-b878-be6cb2902135 with status ACTIVE [ 869.612824] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.613143] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.613219] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.613447] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.613543] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.613723] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.613826] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.613885] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.614074] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.614146] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.614367] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.614465] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.614509] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.614827] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.614827] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.614827] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d5f0b30b-3d64-477a-b878-be6cb2902135 is going to be updated. [ 869.630638] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.630778] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.630859] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.631116] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.631381] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.638146] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.638281] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.638328] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.638534] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.638675] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.638827] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5f0b30b-3d64-477a-b878-be6cb2902135" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.642797] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 753050ac-8ed4-4825-8136-44279adacb0f in Status: IN_PROGRESS for 2s [ 869.716929] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77834f91-37e7-4feb-86e1-583e68d3d852 in Status: SUCCESS [ 869.717163] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.767477] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 753050ac-8ed4-4825-8136-44279adacb0f in Status: SUCCESS [ 869.767729] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-753050ac-8ed4-4825-8136-44279adacb0f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.769793] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05c6d62a-58f1-418b-815e-8b3f7f5cd5eb in Status: SUCCESS [ 869.769977] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.810580] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 in Status: SUCCESS [ 869.810803] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.854090] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bceaf9d-1c44-4281-83d2-4109ac0771c7 in Status: SUCCESS [ 869.854347] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.929686] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 706a5462-e893-428d-beb2-737cbec00439 in Status: SUCCESS [ 869.929899] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.930200] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.930357] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.930555] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.930679] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.930742] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.930896] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.931010] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.931075] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.931168] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.113672] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b50d66d8-0bc1-42fe-b025-b6e5287fc3df',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.434747] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-706a5462-e893-428d-beb2-737cbec00439 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.434747] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.434747] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.435217] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.436070] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.436070] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.436070] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.436070] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.436070] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.436070] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.436070] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-706a5462-e893-428d-beb2-737cbec00439 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.436070] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.436625] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.436625] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.436705] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.436763] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.436821] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.436966] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.437109] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.437177] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.437244] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.615604] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.615766] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.615839] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.616097] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.616197] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.616299] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b50d66d8-0bc1-42fe-b025-b6e5287fc3df is going to be created. [ 870.637024] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.637256] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.637332] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.637531] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.637687] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.647481] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b50d66d8-0bc1-42fe-b025-b6e5287fc3df in Status: UNINITIALIZED for 2s [ 870.940935] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 706a5462-e893-428d-beb2-737cbec00439: rpc.has_security_group_logging(os_id): False [ 870.961026] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.961289] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.961417] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.961643] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.984841] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.985761] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.986055] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.986162] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.986384] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.986493] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.987465] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.987641] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.987745] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.988024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.988325] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.988696] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.988831] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.988923] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.989164] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.989290] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.989427] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 706a5462-e893-428d-beb2-737cbec00439 is going to be updated. [ 871.049773] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.049928] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.050028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.050271] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.050493] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.070030] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 706a5462-e893-428d-beb2-737cbec00439 in Status: IN_PROGRESS for 2s [ 871.261222] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64557eb9-9b83-42ab-99e4-278f5711a22e in Status: SUCCESS [ 871.261322] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64557eb9-9b83-42ab-99e4-278f5711a22e deletion is rescheduled due to dependency. [ 871.261437] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.274625] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e in Status: SUCCESS [ 871.274849] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e deletion is rescheduled due to dependency. [ 871.275016] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.658373] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 753050ac-8ed4-4825-8136-44279adacb0f in Status: SUCCESS [ 871.658692] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 753050ac-8ed4-4825-8136-44279adacb0f deletion is rescheduled due to dependency. [ 871.658753] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-753050ac-8ed4-4825-8136-44279adacb0f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.679026] env[69506]: INFO networking_nsxv3.common.synchronization [req-2cdf2f9a-3944-4080-b4f7-7cb33c5b555e req-fefdf8c5-de30-4d82-afdd-edbbdc58b4ac tempest-ImagesOneServerTestJSON-1625652254 tempest-ImagesOneServerTestJSON-1625652254-project-member] Enqueued Resource ID: 05c6d62a-58f1-418b-815e-8b3f7f5cd5eb with Priority: HIGHEST for action security_group_members [ 871.679026] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05c6d62a-58f1-418b-815e-8b3f7f5cd5eb with Priority: HIGHEST for action security_group_members [ 871.679026] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.679026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.679026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.679026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.679026] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.679026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.679989] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.680227] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.680310] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.680454] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05c6d62a-58f1-418b-815e-8b3f7f5cd5eb',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.880956] env[69506]: INFO networking_nsxv3.common.synchronization [req-d681c73c-c23a-467d-a2d3-b5e5c3efd826 req-eeec3ab8-f0b7-46ca-8d45-c7bdda399e0b tempest-ServersAdminNegativeTestJSON-1868968513 tempest-ServersAdminNegativeTestJSON-1868968513-project-member] Enqueued Resource ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 with Priority: HIGHEST for action security_group_members [ 871.882080] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 with Priority: HIGHEST for action security_group_members [ 871.882223] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-78caaaf6-868f-4043-93dd-d9a75a05d023 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.882524] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.882619] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.882826] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.883009] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.883130] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.883195] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.883346] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.883431] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.883526] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78caaaf6-868f-4043-93dd-d9a75a05d023',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.186226] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.186226] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.186226] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.186226] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.186226] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.186226] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.186226] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.186226] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.186226] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.186226] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.186226] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05c6d62a-58f1-418b-815e-8b3f7f5cd5eb is going to be updated. [ 872.227178] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.227178] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.227178] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.227612] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.228782] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.239022] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05c6d62a-58f1-418b-815e-8b3f7f5cd5eb in Status: IN_PROGRESS for 2s [ 872.304625] env[69506]: INFO networking_nsxv3.common.synchronization [req-451395ca-8628-4b5a-acd9-1a7f15d9d919 req-5b08d742-2755-4737-938c-5130b2a0d977 tempest-AttachVolumeNegativeTest-402732870 tempest-AttachVolumeNegativeTest-402732870-project-member] Enqueued Resource ID: 7dc294f2-c118-4967-a208-cb40fa247a04 with Priority: HIGHEST for action security_group_members [ 872.305270] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dc294f2-c118-4967-a208-cb40fa247a04 with Priority: HIGHEST for action security_group_members [ 872.305703] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dc294f2-c118-4967-a208-cb40fa247a04 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.305839] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dc294f2-c118-4967-a208-cb40fa247a04" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.305882] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dc294f2-c118-4967-a208-cb40fa247a04" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.306785] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dc294f2-c118-4967-a208-cb40fa247a04" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.306977] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.307143] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.307215] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.307790] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.307790] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.307790] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dc294f2-c118-4967-a208-cb40fa247a04',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.386091] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.386388] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.386541] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.386738] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.412023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.412023] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.412023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.412023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.412023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.412023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.412023] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 is going to be updated. [ 872.438202] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.438361] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.438434] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.438706] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.438897] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.449234] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 in Status: IN_PROGRESS for 2s [ 872.656701] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b50d66d8-0bc1-42fe-b025-b6e5287fc3df in Status: SUCCESS [ 872.657383] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b50d66d8-0bc1-42fe-b025-b6e5287fc3df" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.657734] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b50d66d8-0bc1-42fe-b025-b6e5287fc3df" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.658131] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b50d66d8-0bc1-42fe-b025-b6e5287fc3df" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.658514] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.659869] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.659869] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.659869] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.662255] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.662255] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b50d66d8-0bc1-42fe-b025-b6e5287fc3df" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.662255] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b50d66d8-0bc1-42fe-b025-b6e5287fc3df',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.791317] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-477 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.791508] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-477" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.791651] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-477" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.791997] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-477" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.792284] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.792442] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.792553] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.792763] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.792906] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.794206] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 872.794339] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 872.794479] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 872.794567] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 872.794680] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 872.794787] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 872.794925] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 872.815800] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 872.815800] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 872.815800] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 872.815800] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-477" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.815800] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-25cb11d4-4b5b-4fe3-8f46-fa22807fc407 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.815800] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-25cb11d4-4b5b-4fe3-8f46-fa22807fc407" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.815800] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-25cb11d4-4b5b-4fe3-8f46-fa22807fc407" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.815800] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-25cb11d4-4b5b-4fe3-8f46-fa22807fc407" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.815800] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25cb11d4-4b5b-4fe3-8f46-fa22807fc407',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.815800] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.815800] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.815800] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.815800] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.815800] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.816625] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.816625] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.816625] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.816625] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.816625] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.816625] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dc294f2-c118-4967-a208-cb40fa247a04 already deleted. [ 872.816625] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dc294f2-c118-4967-a208-cb40fa247a04" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.083847] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 706a5462-e893-428d-beb2-737cbec00439 in Status: SUCCESS [ 873.084075] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.164423] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-b50d66d8-0bc1-42fe-b025-b6e5287fc3df taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.164596] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b50d66d8-0bc1-42fe-b025-b6e5287fc3df" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.164670] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b50d66d8-0bc1-42fe-b025-b6e5287fc3df" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.164925] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b50d66d8-0bc1-42fe-b025-b6e5287fc3df" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.165109] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.165213] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.165290] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.165444] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.165528] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.165613] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b50d66d8-0bc1-42fe-b025-b6e5287fc3df" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.165757] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-b50d66d8-0bc1-42fe-b025-b6e5287fc3df taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.165841] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b50d66d8-0bc1-42fe-b025-b6e5287fc3df" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.165899] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b50d66d8-0bc1-42fe-b025-b6e5287fc3df" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.166046] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b50d66d8-0bc1-42fe-b025-b6e5287fc3df" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.166186] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.166305] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.166369] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.166513] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.166589] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.166669] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b50d66d8-0bc1-42fe-b025-b6e5287fc3df" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.166757] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b50d66d8-0bc1-42fe-b025-b6e5287fc3df',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.317999] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.318277] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.318410] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.318711] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.318870] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.319113] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 25cb11d4-4b5b-4fe3-8f46-fa22807fc407 not found, creating... [ 873.319483] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.319624] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.320833] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.320833] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.320833] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.320833] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.320833] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.320833] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.321166] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.321166] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.322496] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 25cb11d4-4b5b-4fe3-8f46-fa22807fc407 is going to be created. [ 873.341887] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.341887] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.341887] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.342195] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.342437] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.342847] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-25cb11d4-4b5b-4fe3-8f46-fa22807fc407" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.668608] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b50d66d8-0bc1-42fe-b025-b6e5287fc3df: rpc.has_security_group_logging(os_id): False [ 873.686223] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.686374] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.686452] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.686632] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.686885] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.687145] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.687260] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.687316] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.687590] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.687590] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.687737] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.687810] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.687865] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.688014] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.688095] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.688318] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.688421] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.688488] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.688615] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.688687] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.688777] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b50d66d8-0bc1-42fe-b025-b6e5287fc3df is going to be created. [ 873.748633] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.748823] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.748909] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.749266] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.749482] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.759265] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b50d66d8-0bc1-42fe-b025-b6e5287fc3df in Status: IN_PROGRESS for 2s [ 874.113637] env[69506]: INFO networking_nsxv3.common.synchronization [req-451395ca-8628-4b5a-acd9-1a7f15d9d919 req-1662f494-02de-4745-8e77-e1663549ed0f service nova] Enqueued Resource ID: 7dc294f2-c118-4967-a208-cb40fa247a04 with Priority: HIGHEST for action security_group_rules [ 874.113824] env[69506]: INFO networking_nsxv3.common.synchronization [req-451395ca-8628-4b5a-acd9-1a7f15d9d919 req-1662f494-02de-4745-8e77-e1663549ed0f service nova] Enqueued Resource ID: 7dc294f2-c118-4967-a208-cb40fa247a04 with Priority: HIGHEST for action security_group_members [ 874.114272] env[69506]: INFO networking_nsxv3.common.synchronization [req-451395ca-8628-4b5a-acd9-1a7f15d9d919 req-1662f494-02de-4745-8e77-e1663549ed0f service nova] Enqueued Resource ID: 25cb11d4-4b5b-4fe3-8f46-fa22807fc407 with Priority: HIGHEST for action port [ 874.114527] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dc294f2-c118-4967-a208-cb40fa247a04 with Priority: HIGHEST for action security_group_rules [ 874.114657] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dc294f2-c118-4967-a208-cb40fa247a04 with Priority: HIGHEST for action security_group_members [ 874.114752] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25cb11d4-4b5b-4fe3-8f46-fa22807fc407 with Priority: HIGHEST for action port [ 874.115385] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7dc294f2-c118-4967-a208-cb40fa247a04 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.115514] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7dc294f2-c118-4967-a208-cb40fa247a04" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.115595] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7dc294f2-c118-4967-a208-cb40fa247a04" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.115814] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7dc294f2-c118-4967-a208-cb40fa247a04" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.115897] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7dc294f2-c118-4967-a208-cb40fa247a04',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.116764] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dc294f2-c118-4967-a208-cb40fa247a04 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.116887] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dc294f2-c118-4967-a208-cb40fa247a04" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.116955] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dc294f2-c118-4967-a208-cb40fa247a04" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.117573] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dc294f2-c118-4967-a208-cb40fa247a04" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.117740] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.117829] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.117897] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.118057] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.118164] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.118232] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dc294f2-c118-4967-a208-cb40fa247a04',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.119065] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-25cb11d4-4b5b-4fe3-8f46-fa22807fc407 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.119219] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25cb11d4-4b5b-4fe3-8f46-fa22807fc407" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.119326] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25cb11d4-4b5b-4fe3-8f46-fa22807fc407" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.119486] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25cb11d4-4b5b-4fe3-8f46-fa22807fc407" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.119786] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25cb11d4-4b5b-4fe3-8f46-fa22807fc407',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.249530] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05c6d62a-58f1-418b-815e-8b3f7f5cd5eb in Status: SUCCESS [ 874.249872] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05c6d62a-58f1-418b-815e-8b3f7f5cd5eb deletion is rescheduled due to dependency. [ 874.250041] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.458949] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 in Status: SUCCESS [ 874.459195] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 deletion is rescheduled due to dependency. [ 874.459299] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.621404] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7dc294f2-c118-4967-a208-cb40fa247a04',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.623807] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dc294f2-c118-4967-a208-cb40fa247a04 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.623807] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dc294f2-c118-4967-a208-cb40fa247a04" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.623807] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 25cb11d4-4b5b-4fe3-8f46-fa22807fc407 with status ACTIVE [ 874.623807] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.623807] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.623807] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.624203] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.624203] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.628035] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.628170] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.628170] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.628323] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.628418] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.628647] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.628750] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.628998] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.628998] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.629184] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.629184] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 25cb11d4-4b5b-4fe3-8f46-fa22807fc407 is going to be updated. [ 874.649549] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.649830] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.649830] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.650028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.650194] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.650370] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25cb11d4-4b5b-4fe3-8f46-fa22807fc407" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.883521] env[69506]: INFO networking_nsxv3.common.synchronization [req-25bb4b8e-001f-4928-9eaf-915e884985a6 req-85f0959b-8c72-4eac-853c-b3c6eed0f288 tempest-ServerActionsV293TestJSON-229040708 tempest-ServerActionsV293TestJSON-229040708-project-member] Enqueued Resource ID: 0210561b-43ff-434b-97ef-339a5d85a2a9 with Priority: HIGHEST for action security_group_members [ 874.883521] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0210561b-43ff-434b-97ef-339a5d85a2a9 with Priority: HIGHEST for action security_group_members [ 874.883984] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0210561b-43ff-434b-97ef-339a5d85a2a9 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.884302] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0210561b-43ff-434b-97ef-339a5d85a2a9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.884483] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0210561b-43ff-434b-97ef-339a5d85a2a9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.885029] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0210561b-43ff-434b-97ef-339a5d85a2a9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.885329] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.885576] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.886925] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.886925] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.886925] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.886925] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0210561b-43ff-434b-97ef-339a5d85a2a9',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.131697] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7dc294f2-c118-4967-a208-cb40fa247a04',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.392632] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.392847] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.393016] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.393253] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.393392] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.393671] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.393807] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.393899] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.394120] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.394239] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.394339] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0210561b-43ff-434b-97ef-339a5d85a2a9 already deleted. [ 875.394451] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0210561b-43ff-434b-97ef-339a5d85a2a9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.462849] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-225 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.463666] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-225" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.463666] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-225" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.463666] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-225" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.463938] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.464782] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.464782] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.464961] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.465074] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.465328] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 875.465472] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 875.465619] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 875.465797] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 875.465944] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 875.466076] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 875.466253] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 875.487815] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 875.487815] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 875.487815] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 875.488046] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-225" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.489028] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-c4130e5b-7924-40f4-b73d-9f246734d9e5 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.489028] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-c4130e5b-7924-40f4-b73d-9f246734d9e5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.489028] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-c4130e5b-7924-40f4-b73d-9f246734d9e5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.489028] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-c4130e5b-7924-40f4-b73d-9f246734d9e5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.489446] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4130e5b-7924-40f4-b73d-9f246734d9e5',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.634352] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.634558] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.634648] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.634869] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.634991] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.635178] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dc294f2-c118-4967-a208-cb40fa247a04 is going to be created. [ 875.658974] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.659434] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.659698] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.659966] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.660160] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.670756] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dc294f2-c118-4967-a208-cb40fa247a04 in Status: UNINITIALIZED for 2s [ 875.775379] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b50d66d8-0bc1-42fe-b025-b6e5287fc3df in Status: SUCCESS [ 875.775624] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b50d66d8-0bc1-42fe-b025-b6e5287fc3df" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.992486] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.992854] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.992854] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.993181] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.993383] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.993579] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port c4130e5b-7924-40f4-b73d-9f246734d9e5 not found, creating... [ 875.993934] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.994089] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.994241] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.994481] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.994658] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.994978] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.995217] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.995549] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.995621] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.995751] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.995925] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: c4130e5b-7924-40f4-b73d-9f246734d9e5 is going to be created. [ 876.016276] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.016368] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.016487] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.016748] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.019017] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.019017] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-c4130e5b-7924-40f4-b73d-9f246734d9e5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.955337] env[69506]: INFO networking_nsxv3.common.synchronization [req-25bb4b8e-001f-4928-9eaf-915e884985a6 req-003df279-9778-4b58-a6d6-8a209632d5af service nova] Enqueued Resource ID: 0210561b-43ff-434b-97ef-339a5d85a2a9 with Priority: HIGHEST for action security_group_rules [ 876.955519] env[69506]: INFO networking_nsxv3.common.synchronization [req-25bb4b8e-001f-4928-9eaf-915e884985a6 req-003df279-9778-4b58-a6d6-8a209632d5af service nova] Enqueued Resource ID: 0210561b-43ff-434b-97ef-339a5d85a2a9 with Priority: HIGHEST for action security_group_members [ 876.955659] env[69506]: INFO networking_nsxv3.common.synchronization [req-25bb4b8e-001f-4928-9eaf-915e884985a6 req-003df279-9778-4b58-a6d6-8a209632d5af service nova] Enqueued Resource ID: c4130e5b-7924-40f4-b73d-9f246734d9e5 with Priority: HIGHEST for action port [ 876.955895] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0210561b-43ff-434b-97ef-339a5d85a2a9 with Priority: HIGHEST for action security_group_rules [ 876.956027] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0210561b-43ff-434b-97ef-339a5d85a2a9 with Priority: HIGHEST for action security_group_members [ 876.956126] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4130e5b-7924-40f4-b73d-9f246734d9e5 with Priority: HIGHEST for action port [ 876.956677] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0210561b-43ff-434b-97ef-339a5d85a2a9 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.956802] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0210561b-43ff-434b-97ef-339a5d85a2a9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.956868] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0210561b-43ff-434b-97ef-339a5d85a2a9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.958708] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0210561b-43ff-434b-97ef-339a5d85a2a9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.958708] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0210561b-43ff-434b-97ef-339a5d85a2a9',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.960424] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0210561b-43ff-434b-97ef-339a5d85a2a9 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.960424] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0210561b-43ff-434b-97ef-339a5d85a2a9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.960558] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0210561b-43ff-434b-97ef-339a5d85a2a9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.961469] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0210561b-43ff-434b-97ef-339a5d85a2a9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.961469] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.961469] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.961469] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.961469] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.961469] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.961469] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0210561b-43ff-434b-97ef-339a5d85a2a9',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.962031] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4130e5b-7924-40f4-b73d-9f246734d9e5 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.962137] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4130e5b-7924-40f4-b73d-9f246734d9e5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.962202] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4130e5b-7924-40f4-b73d-9f246734d9e5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.962346] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4130e5b-7924-40f4-b73d-9f246734d9e5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.962415] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4130e5b-7924-40f4-b73d-9f246734d9e5',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.463960] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0210561b-43ff-434b-97ef-339a5d85a2a9',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.465009] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0210561b-43ff-434b-97ef-339a5d85a2a9 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.465146] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0210561b-43ff-434b-97ef-339a5d85a2a9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.465533] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c4130e5b-7924-40f4-b73d-9f246734d9e5 with status ACTIVE [ 877.465647] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.465756] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.465821] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.469317] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.469413] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.469606] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.469707] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.469770] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.469931] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.470486] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.470486] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.470486] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.470486] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.470756] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.470756] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.470756] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c4130e5b-7924-40f4-b73d-9f246734d9e5 is going to be updated. [ 877.491190] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.491377] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.491434] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.491645] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.491741] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.491903] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4130e5b-7924-40f4-b73d-9f246734d9e5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.540932] env[69506]: INFO networking_nsxv3.common.synchronization [req-9bb44358-f521-4adf-963f-dc7acfa5d57a req-f66e793c-5c36-4007-ad6d-649568b24a03 tempest-AttachInterfacesTestJSON-2055467997 tempest-AttachInterfacesTestJSON-2055467997-project-member] Enqueued Resource ID: 2d66cc0b-bd33-47cb-9365-01d39638c887 with Priority: HIGHEST for action security_group_members [ 877.541501] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d66cc0b-bd33-47cb-9365-01d39638c887 with Priority: HIGHEST for action security_group_members [ 877.541806] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d66cc0b-bd33-47cb-9365-01d39638c887 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.541923] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d66cc0b-bd33-47cb-9365-01d39638c887" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.541991] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d66cc0b-bd33-47cb-9365-01d39638c887" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.543117] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d66cc0b-bd33-47cb-9365-01d39638c887" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.543117] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.543117] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.543117] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.543335] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.543335] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.543404] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d66cc0b-bd33-47cb-9365-01d39638c887',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.682178] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dc294f2-c118-4967-a208-cb40fa247a04 in Status: SUCCESS [ 877.682499] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dc294f2-c118-4967-a208-cb40fa247a04" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.682756] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dc294f2-c118-4967-a208-cb40fa247a04" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.682904] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dc294f2-c118-4967-a208-cb40fa247a04" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.683137] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.683268] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.683337] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.683786] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.683786] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.683786] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dc294f2-c118-4967-a208-cb40fa247a04" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.683786] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7dc294f2-c118-4967-a208-cb40fa247a04',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.913830] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-868 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.913980] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-868" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.914237] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-868" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.914662] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-868" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.915634] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.915634] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.915634] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.915915] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.916204] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.916552] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 877.916758] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 877.916972] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 877.917276] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 877.918040] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 877.918040] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 877.918040] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 877.937654] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 877.937654] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 877.937855] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 877.937998] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-868" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.938398] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-f1916242-0284-48e6-9185-c35405b39d5f taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.938667] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-f1916242-0284-48e6-9185-c35405b39d5f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.938775] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-f1916242-0284-48e6-9185-c35405b39d5f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.939075] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-f1916242-0284-48e6-9185-c35405b39d5f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.939257] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1916242-0284-48e6-9185-c35405b39d5f',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.965927] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0210561b-43ff-434b-97ef-339a5d85a2a9',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.045757] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.045871] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.045871] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.046208] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.046334] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.046620] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.047435] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.047435] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.047435] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.047435] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.047435] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d66cc0b-bd33-47cb-9365-01d39638c887 already deleted. [ 878.047435] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d66cc0b-bd33-47cb-9365-01d39638c887" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.187445] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7dc294f2-c118-4967-a208-cb40fa247a04',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.441721] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.441903] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.442141] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.442476] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.442687] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.442901] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port f1916242-0284-48e6-9185-c35405b39d5f not found, creating... [ 878.443336] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.443551] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.443696] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.444041] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.444235] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.444616] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.445251] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.445251] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.445407] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.445475] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.445682] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: f1916242-0284-48e6-9185-c35405b39d5f is going to be created. [ 878.468355] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.468797] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.468904] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.470750] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.471122] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.471457] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-f1916242-0284-48e6-9185-c35405b39d5f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.472990] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.473880] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.473968] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.474237] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.474350] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.474492] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0210561b-43ff-434b-97ef-339a5d85a2a9 is going to be created. [ 878.518740] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.519009] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.519231] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.519517] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.519764] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.550149] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0210561b-43ff-434b-97ef-339a5d85a2a9 in Status: UNINITIALIZED for 2s [ 878.689811] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7dc294f2-c118-4967-a208-cb40fa247a04: rpc.has_security_group_logging(os_id): False [ 878.711164] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.711372] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.711490] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.711841] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.712235] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.712556] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.712694] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.712795] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.713049] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.713178] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.713326] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7dc294f2-c118-4967-a208-cb40fa247a04 is going to be created. [ 878.789260] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.789524] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.789524] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.789771] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.789952] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.800644] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dc294f2-c118-4967-a208-cb40fa247a04 in Status: IN_PROGRESS for 2s [ 879.444208] env[69506]: INFO networking_nsxv3.common.synchronization [req-9bb44358-f521-4adf-963f-dc7acfa5d57a req-ea07f88a-6a29-4d3c-aea8-798424911654 service nova] Enqueued Resource ID: 2d66cc0b-bd33-47cb-9365-01d39638c887 with Priority: HIGHEST for action security_group_rules [ 879.444208] env[69506]: INFO networking_nsxv3.common.synchronization [req-9bb44358-f521-4adf-963f-dc7acfa5d57a req-ea07f88a-6a29-4d3c-aea8-798424911654 service nova] Enqueued Resource ID: 2d66cc0b-bd33-47cb-9365-01d39638c887 with Priority: HIGHEST for action security_group_members [ 879.444208] env[69506]: INFO networking_nsxv3.common.synchronization [req-9bb44358-f521-4adf-963f-dc7acfa5d57a req-ea07f88a-6a29-4d3c-aea8-798424911654 service nova] Enqueued Resource ID: f1916242-0284-48e6-9185-c35405b39d5f with Priority: HIGHEST for action port [ 879.444419] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d66cc0b-bd33-47cb-9365-01d39638c887 with Priority: HIGHEST for action security_group_rules [ 879.444716] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d66cc0b-bd33-47cb-9365-01d39638c887 with Priority: HIGHEST for action security_group_members [ 879.444930] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1916242-0284-48e6-9185-c35405b39d5f with Priority: HIGHEST for action port [ 879.445617] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d66cc0b-bd33-47cb-9365-01d39638c887 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.445890] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d66cc0b-bd33-47cb-9365-01d39638c887" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.446074] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d66cc0b-bd33-47cb-9365-01d39638c887" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.446394] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d66cc0b-bd33-47cb-9365-01d39638c887" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.446579] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d66cc0b-bd33-47cb-9365-01d39638c887',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.448032] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d66cc0b-bd33-47cb-9365-01d39638c887 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.448322] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d66cc0b-bd33-47cb-9365-01d39638c887" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.448598] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d66cc0b-bd33-47cb-9365-01d39638c887" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.448955] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d66cc0b-bd33-47cb-9365-01d39638c887" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.449399] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.449701] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.449947] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.450225] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.450717] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.450924] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d66cc0b-bd33-47cb-9365-01d39638c887',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.451915] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1916242-0284-48e6-9185-c35405b39d5f taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.452246] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1916242-0284-48e6-9185-c35405b39d5f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.452410] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1916242-0284-48e6-9185-c35405b39d5f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.452658] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1916242-0284-48e6-9185-c35405b39d5f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.453056] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1916242-0284-48e6-9185-c35405b39d5f',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.497023] env[69506]: INFO networking_nsxv3.common.synchronization [req-62683dbb-23dc-45da-a37c-8f7a72efe1f5 req-3010174c-6b8a-4551-a39e-d4bec5cd03a9 tempest-ImagesNegativeTestJSON-8871123 tempest-ImagesNegativeTestJSON-8871123-project-member] Enqueued Resource ID: b50d66d8-0bc1-42fe-b025-b6e5287fc3df with Priority: HIGHEST for action security_group_members [ 879.497023] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b50d66d8-0bc1-42fe-b025-b6e5287fc3df with Priority: HIGHEST for action security_group_members [ 879.497023] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-b50d66d8-0bc1-42fe-b025-b6e5287fc3df taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.497023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b50d66d8-0bc1-42fe-b025-b6e5287fc3df" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.497023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b50d66d8-0bc1-42fe-b025-b6e5287fc3df" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.497023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b50d66d8-0bc1-42fe-b025-b6e5287fc3df" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.497023] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.498083] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.498232] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.498462] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.498601] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.498766] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b50d66d8-0bc1-42fe-b025-b6e5287fc3df',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.954677] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f1916242-0284-48e6-9185-c35405b39d5f with status ACTIVE [ 879.955199] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.955199] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.955199] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.955416] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.955465] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.955741] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.955817] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.955817] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.955978] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.956078] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.956270] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.956413] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.956519] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.956696] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.956774] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.956863] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f1916242-0284-48e6-9185-c35405b39d5f is going to be updated. [ 879.958643] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d66cc0b-bd33-47cb-9365-01d39638c887 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.958643] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d66cc0b-bd33-47cb-9365-01d39638c887" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.958643] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d66cc0b-bd33-47cb-9365-01d39638c887',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.978628] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.978744] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.978806] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.978992] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.979212] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.979438] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1916242-0284-48e6-9185-c35405b39d5f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.002883] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.003073] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.003143] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.003446] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.003541] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.003742] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.003842] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.003908] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.004080] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.004159] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.004266] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b50d66d8-0bc1-42fe-b025-b6e5287fc3df is going to be updated. [ 880.030286] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.030458] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.030514] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.030726] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.030885] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.039892] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b50d66d8-0bc1-42fe-b025-b6e5287fc3df in Status: IN_PROGRESS for 2s [ 880.462698] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d66cc0b-bd33-47cb-9365-01d39638c887',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.560256] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0210561b-43ff-434b-97ef-339a5d85a2a9 in Status: SUCCESS [ 880.560569] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0210561b-43ff-434b-97ef-339a5d85a2a9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.560637] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0210561b-43ff-434b-97ef-339a5d85a2a9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.560849] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0210561b-43ff-434b-97ef-339a5d85a2a9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.561051] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.561168] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.561276] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.561380] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.561483] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.561585] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0210561b-43ff-434b-97ef-339a5d85a2a9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.561698] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0210561b-43ff-434b-97ef-339a5d85a2a9',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.815105] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dc294f2-c118-4967-a208-cb40fa247a04 in Status: SUCCESS [ 880.815340] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7dc294f2-c118-4967-a208-cb40fa247a04" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.966346] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.966346] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.966346] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.966346] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.966637] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.966637] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d66cc0b-bd33-47cb-9365-01d39638c887 is going to be created. [ 881.012181] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.012428] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.012532] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.012826] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.013034] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.022514] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d66cc0b-bd33-47cb-9365-01d39638c887 in Status: UNINITIALIZED for 2s [ 881.065454] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0210561b-43ff-434b-97ef-339a5d85a2a9',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.568102] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0210561b-43ff-434b-97ef-339a5d85a2a9: rpc.has_security_group_logging(os_id): False [ 881.594665] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.594840] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.594840] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.595341] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.595341] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.595517] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.595577] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.595627] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.595785] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.595869] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.595948] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0210561b-43ff-434b-97ef-339a5d85a2a9 is going to be created. [ 881.674664] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.674791] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.674842] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.675070] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.675370] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.691817] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0210561b-43ff-434b-97ef-339a5d85a2a9 in Status: IN_PROGRESS for 2s [ 882.050795] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b50d66d8-0bc1-42fe-b025-b6e5287fc3df in Status: SUCCESS [ 882.050795] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b50d66d8-0bc1-42fe-b025-b6e5287fc3df deletion is rescheduled due to dependency. [ 882.050795] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b50d66d8-0bc1-42fe-b025-b6e5287fc3df" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.319611] env[69506]: INFO networking_nsxv3.common.synchronization [req-1e85f902-419a-4344-b932-1de161a3f695 req-9c0bab00-60cb-4c33-829a-ac1830ecf35c tempest-ServerRescueTestJSON-235851791 tempest-ServerRescueTestJSON-235851791-project-member] Enqueued Resource ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 with Priority: HIGHEST for action security_group_members [ 882.323723] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 with Priority: HIGHEST for action security_group_members [ 882.327317] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-65fb79f7-95e7-4be9-b5bb-64c57bc42333 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.327476] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.327561] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.327849] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.328609] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.328609] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.328609] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.328609] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.328908] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.328908] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65fb79f7-95e7-4be9-b5bb-64c57bc42333',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.380969] env[69506]: INFO networking_nsxv3.common.synchronization [req-94c9a692-8268-48da-aa92-24f94ded7cab req-ce1cdb94-2f53-444c-9e6a-1c8b1ffd857b tempest-ListImageFiltersTestJSON-525149621 tempest-ListImageFiltersTestJSON-525149621-project-member] Enqueued Resource ID: 458c7186-d79f-4548-a2a0-95db0abbb880 with Priority: HIGHEST for action security_group_members [ 882.381865] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 458c7186-d79f-4548-a2a0-95db0abbb880 with Priority: HIGHEST for action security_group_members [ 882.382332] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-458c7186-d79f-4548-a2a0-95db0abbb880 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.382508] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.382735] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.382960] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.383200] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.383364] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.383456] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.383681] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.383805] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.383939] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('458c7186-d79f-4548-a2a0-95db0abbb880',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.770019] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-438 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.770019] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.770019] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.770019] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.770019] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.770669] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.770954] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.771329] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.771635] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.772016] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 882.774704] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 882.774704] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 882.774704] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 882.774704] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 882.774704] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 882.774704] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 882.793021] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 882.793021] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 882.793021] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 882.793021] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.793021] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-2c88f43d-d7cb-4114-ab32-0329a1b4fc87 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.793021] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-2c88f43d-d7cb-4114-ab32-0329a1b4fc87" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.793021] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-2c88f43d-d7cb-4114-ab32-0329a1b4fc87" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.793021] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-2c88f43d-d7cb-4114-ab32-0329a1b4fc87" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.793021] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c88f43d-d7cb-4114-ab32-0329a1b4fc87',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.832728] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.839022] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.839022] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.839022] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.854354] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.854613] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.854723] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.854787] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.855136] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.855136] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.855251] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 is going to be updated. [ 882.878419] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.878419] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.878419] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.878710] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.878710] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.886199] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 in Status: IN_PROGRESS for 2s [ 882.886804] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.887047] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.887205] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.887582] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.887582] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.887811] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.887936] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.888009] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.888180] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.888260] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.888347] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 458c7186-d79f-4548-a2a0-95db0abbb880 already deleted. [ 882.888428] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.032226] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d66cc0b-bd33-47cb-9365-01d39638c887 in Status: SUCCESS [ 883.032452] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d66cc0b-bd33-47cb-9365-01d39638c887" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.032623] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d66cc0b-bd33-47cb-9365-01d39638c887" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.032846] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d66cc0b-bd33-47cb-9365-01d39638c887" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.033055] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.033178] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.033245] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.033400] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.033481] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.033565] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d66cc0b-bd33-47cb-9365-01d39638c887" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.033653] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d66cc0b-bd33-47cb-9365-01d39638c887',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.295955] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.296203] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.296320] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.296614] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.296765] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.296926] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 2c88f43d-d7cb-4114-ab32-0329a1b4fc87 not found, creating... [ 883.297248] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.297407] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.297529] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.297750] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.297898] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.298542] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.298739] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.298844] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.299079] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.299318] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.299469] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 2c88f43d-d7cb-4114-ab32-0329a1b4fc87 is going to be created. [ 883.320296] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.320581] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.320650] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.320944] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.321220] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.321484] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-2c88f43d-d7cb-4114-ab32-0329a1b4fc87" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.536206] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d66cc0b-bd33-47cb-9365-01d39638c887',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.704624] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0210561b-43ff-434b-97ef-339a5d85a2a9 in Status: SUCCESS [ 883.704624] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0210561b-43ff-434b-97ef-339a5d85a2a9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.037552] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d66cc0b-bd33-47cb-9365-01d39638c887: rpc.has_security_group_logging(os_id): False [ 884.057754] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.057924] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.057988] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.058242] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.058340] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.058527] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.058621] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.058744] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.058872] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.058977] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.059074] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d66cc0b-bd33-47cb-9365-01d39638c887 is going to be created. [ 884.065797] env[69506]: INFO networking_nsxv3.common.synchronization [req-94c9a692-8268-48da-aa92-24f94ded7cab req-92c6a37e-d2e9-4c88-8250-48e2b44bbfaf service nova] Enqueued Resource ID: 458c7186-d79f-4548-a2a0-95db0abbb880 with Priority: HIGHEST for action security_group_rules [ 884.065970] env[69506]: INFO networking_nsxv3.common.synchronization [req-94c9a692-8268-48da-aa92-24f94ded7cab req-92c6a37e-d2e9-4c88-8250-48e2b44bbfaf service nova] Enqueued Resource ID: 458c7186-d79f-4548-a2a0-95db0abbb880 with Priority: HIGHEST for action security_group_members [ 884.066130] env[69506]: INFO networking_nsxv3.common.synchronization [req-94c9a692-8268-48da-aa92-24f94ded7cab req-92c6a37e-d2e9-4c88-8250-48e2b44bbfaf service nova] Enqueued Resource ID: 2c88f43d-d7cb-4114-ab32-0329a1b4fc87 with Priority: HIGHEST for action port [ 884.066621] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 458c7186-d79f-4548-a2a0-95db0abbb880 with Priority: HIGHEST for action security_group_rules [ 884.066750] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 458c7186-d79f-4548-a2a0-95db0abbb880 with Priority: HIGHEST for action security_group_members [ 884.066889] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c88f43d-d7cb-4114-ab32-0329a1b4fc87 with Priority: HIGHEST for action port [ 884.068239] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-458c7186-d79f-4548-a2a0-95db0abbb880 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.069977] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.069977] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.069977] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.069977] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('458c7186-d79f-4548-a2a0-95db0abbb880',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.069977] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-458c7186-d79f-4548-a2a0-95db0abbb880 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.069977] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.069977] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.069977] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.070598] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.070598] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.070598] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.070598] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.070598] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.070598] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('458c7186-d79f-4548-a2a0-95db0abbb880',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.071581] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c88f43d-d7cb-4114-ab32-0329a1b4fc87 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.071703] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c88f43d-d7cb-4114-ab32-0329a1b4fc87" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.071776] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c88f43d-d7cb-4114-ab32-0329a1b4fc87" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.071987] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c88f43d-d7cb-4114-ab32-0329a1b4fc87" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.073065] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c88f43d-d7cb-4114-ab32-0329a1b4fc87',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.115912] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.116077] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.116156] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.116364] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.116989] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.125930] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d66cc0b-bd33-47cb-9365-01d39638c887 in Status: IN_PROGRESS for 2s [ 884.575386] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('458c7186-d79f-4548-a2a0-95db0abbb880',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.577053] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-458c7186-d79f-4548-a2a0-95db0abbb880 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.577053] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.577302] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c88f43d-d7cb-4114-ab32-0329a1b4fc87 with status ACTIVE [ 884.577481] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.577655] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.577906] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.577906] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.577999] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.578339] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.578457] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.578527] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.578685] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.578768] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.579130] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.579130] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.579331] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.579384] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.579448] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.579531] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c88f43d-d7cb-4114-ab32-0329a1b4fc87 is going to be updated. [ 884.600279] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.600448] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.600531] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.600735] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.600868] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.601038] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c88f43d-d7cb-4114-ab32-0329a1b4fc87" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.896011] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 in Status: SUCCESS [ 884.896346] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 deletion is rescheduled due to dependency. [ 884.896489] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.081238] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('458c7186-d79f-4548-a2a0-95db0abbb880',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.586638] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.586638] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.586638] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.586638] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.586638] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.586638] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 458c7186-d79f-4548-a2a0-95db0abbb880 is going to be created. [ 885.608723] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.609176] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.609360] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.610255] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.610520] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.621133] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 458c7186-d79f-4548-a2a0-95db0abbb880 in Status: UNINITIALIZED for 2s [ 885.922906] env[69506]: INFO networking_nsxv3.common.synchronization [req-9c7fdd3c-707a-47bb-a24d-5374debac771 req-b9793600-0f57-49ec-9fe9-4355e528b62f tempest-ListImageFiltersTestJSON-525149621 tempest-ListImageFiltersTestJSON-525149621-project-member] Enqueued Resource ID: 458c7186-d79f-4548-a2a0-95db0abbb880 with Priority: HIGHEST for action security_group_members [ 885.924493] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 458c7186-d79f-4548-a2a0-95db0abbb880 with Priority: HIGHEST for action security_group_members [ 885.925169] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-458c7186-d79f-4548-a2a0-95db0abbb880 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.925169] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.146501] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d66cc0b-bd33-47cb-9365-01d39638c887 in Status: SUCCESS [ 886.146891] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d66cc0b-bd33-47cb-9365-01d39638c887" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.304819] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-438 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.305112] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.305290] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.305633] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.305944] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.306154] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.306328] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.306596] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.306798] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.307071] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 886.311016] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 886.311016] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 886.311016] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 886.311016] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 886.311016] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 886.311016] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 886.333382] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 886.333536] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 886.333681] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 886.333867] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-438" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.334350] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-27c5cbd2-0fb9-447c-ab93-f674133e481b taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.334506] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-27c5cbd2-0fb9-447c-ab93-f674133e481b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.334581] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-27c5cbd2-0fb9-447c-ab93-f674133e481b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.334944] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-27c5cbd2-0fb9-447c-ab93-f674133e481b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.335119] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27c5cbd2-0fb9-447c-ab93-f674133e481b',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.552864] env[69506]: INFO networking_nsxv3.common.synchronization [None req-07191015-5675-4420-b2bc-55c4ebfe595e tempest-ServerRescueNegativeTestJSON-1844285858 tempest-ServerRescueNegativeTestJSON-1844285858-project-member] Enqueued Resource ID: 20940711-36df-48c2-b8ae-df2cfecaebc8 with Priority: HIGHEST for action security_group_rules [ 886.553428] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20940711-36df-48c2-b8ae-df2cfecaebc8 with Priority: HIGHEST for action security_group_rules [ 886.553733] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20940711-36df-48c2-b8ae-df2cfecaebc8 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.553856] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20940711-36df-48c2-b8ae-df2cfecaebc8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.553922] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20940711-36df-48c2-b8ae-df2cfecaebc8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.554185] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20940711-36df-48c2-b8ae-df2cfecaebc8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.554266] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20940711-36df-48c2-b8ae-df2cfecaebc8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.680655] env[69506]: INFO networking_nsxv3.common.synchronization [None req-e8f7c9b0-cd96-4d82-aa1c-5a407289d452 tempest-ServerRescueNegativeTestJSON-1844285858 tempest-ServerRescueNegativeTestJSON-1844285858-project-member] Enqueued Resource ID: 20940711-36df-48c2-b8ae-df2cfecaebc8 with Priority: HIGHEST for action security_group_rules [ 886.681273] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20940711-36df-48c2-b8ae-df2cfecaebc8 with Priority: HIGHEST for action security_group_rules [ 886.681631] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20940711-36df-48c2-b8ae-df2cfecaebc8 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.681774] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20940711-36df-48c2-b8ae-df2cfecaebc8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.841021] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.841021] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.841021] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.841021] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.841021] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.841021] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 27c5cbd2-0fb9-447c-ab93-f674133e481b not found, creating... [ 886.841021] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.841021] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.841021] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.841021] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.841021] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.841557] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.841557] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.841557] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.841557] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.841557] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.841920] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 27c5cbd2-0fb9-447c-ab93-f674133e481b is going to be created. [ 886.861196] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.863200] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.863200] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.863200] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.863200] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.863200] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-27c5cbd2-0fb9-447c-ab93-f674133e481b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.076834] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.076995] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.077076] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.077297] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.077385] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.077478] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20940711-36df-48c2-b8ae-df2cfecaebc8 already deleted. [ 887.077562] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20940711-36df-48c2-b8ae-df2cfecaebc8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.077713] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20940711-36df-48c2-b8ae-df2cfecaebc8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.077861] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20940711-36df-48c2-b8ae-df2cfecaebc8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.077938] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20940711-36df-48c2-b8ae-df2cfecaebc8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.599110] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.599441] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.599441] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.599566] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.599665] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.599767] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20940711-36df-48c2-b8ae-df2cfecaebc8 already deleted. [ 887.599851] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20940711-36df-48c2-b8ae-df2cfecaebc8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.629921] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 458c7186-d79f-4548-a2a0-95db0abbb880 in Status: SUCCESS [ 887.630750] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.630750] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.630750] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.631027] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.631027] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.631027] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.631155] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.631235] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.631322] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.631419] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('458c7186-d79f-4548-a2a0-95db0abbb880',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.632343] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.632584] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.632751] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.632883] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.632986] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.633153] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.633258] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.633369] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('458c7186-d79f-4548-a2a0-95db0abbb880',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.801122] env[69506]: INFO networking_nsxv3.common.synchronization [req-9c7fdd3c-707a-47bb-a24d-5374debac771 req-5a056bc7-739e-4a8e-a391-4dacc69e98dc service nova] Enqueued Resource ID: 458c7186-d79f-4548-a2a0-95db0abbb880 with Priority: HIGHEST for action security_group_rules [ 887.801279] env[69506]: INFO networking_nsxv3.common.synchronization [req-9c7fdd3c-707a-47bb-a24d-5374debac771 req-5a056bc7-739e-4a8e-a391-4dacc69e98dc service nova] Enqueued Resource ID: 458c7186-d79f-4548-a2a0-95db0abbb880 with Priority: HIGHEST for action security_group_members [ 887.801408] env[69506]: INFO networking_nsxv3.common.synchronization [req-9c7fdd3c-707a-47bb-a24d-5374debac771 req-5a056bc7-739e-4a8e-a391-4dacc69e98dc service nova] Enqueued Resource ID: 27c5cbd2-0fb9-447c-ab93-f674133e481b with Priority: HIGHEST for action port [ 887.804020] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 458c7186-d79f-4548-a2a0-95db0abbb880 with Priority: HIGHEST for action security_group_rules [ 887.804020] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 458c7186-d79f-4548-a2a0-95db0abbb880 with Priority: HIGHEST for action security_group_members [ 887.804020] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27c5cbd2-0fb9-447c-ab93-f674133e481b with Priority: HIGHEST for action port [ 887.804020] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-458c7186-d79f-4548-a2a0-95db0abbb880 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.804020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.804020] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-458c7186-d79f-4548-a2a0-95db0abbb880 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.804020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.804020] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-27c5cbd2-0fb9-447c-ab93-f674133e481b taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.804020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27c5cbd2-0fb9-447c-ab93-f674133e481b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.804020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27c5cbd2-0fb9-447c-ab93-f674133e481b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.804020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27c5cbd2-0fb9-447c-ab93-f674133e481b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.804020] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27c5cbd2-0fb9-447c-ab93-f674133e481b',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.135715] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-458c7186-d79f-4548-a2a0-95db0abbb880 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.135715] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.137095] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('458c7186-d79f-4548-a2a0-95db0abbb880',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.308084] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 27c5cbd2-0fb9-447c-ab93-f674133e481b with status ACTIVE [ 888.308084] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.308084] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.308084] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.308084] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.308084] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.308084] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.308084] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.308084] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.308523] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.308523] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.308640] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.308640] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.308722] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.308805] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.309411] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.309411] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 27c5cbd2-0fb9-447c-ab93-f674133e481b is going to be updated. [ 888.328209] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.328356] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.328428] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.328634] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.328765] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.328928] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27c5cbd2-0fb9-447c-ab93-f674133e481b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.640875] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('458c7186-d79f-4548-a2a0-95db0abbb880',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.144142] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.144142] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.144142] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.144142] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.144372] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.144372] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 458c7186-d79f-4548-a2a0-95db0abbb880 is going to be updated. [ 889.170435] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.170652] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.170949] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.171072] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.171172] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.179450] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 458c7186-d79f-4548-a2a0-95db0abbb880 in Status: IN_PROGRESS for 2s [ 891.190689] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 458c7186-d79f-4548-a2a0-95db0abbb880 in Status: SUCCESS [ 891.191148] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.191496] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.191897] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.192241] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.192376] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.192449] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.192658] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.192746] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.192900] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('458c7186-d79f-4548-a2a0-95db0abbb880',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.695073] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('458c7186-d79f-4548-a2a0-95db0abbb880',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.198816] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('458c7186-d79f-4548-a2a0-95db0abbb880',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.702416] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.703855] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.703855] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.704057] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.704346] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.704520] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 458c7186-d79f-4548-a2a0-95db0abbb880 is going to be updated. [ 892.731211] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.731494] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.731666] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.731965] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.732078] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.740157] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 458c7186-d79f-4548-a2a0-95db0abbb880 in Status: IN_PROGRESS for 2s [ 892.803830] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 892.803990] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 894.750640] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 458c7186-d79f-4548-a2a0-95db0abbb880 in Status: SUCCESS [ 894.750954] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.751031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.751238] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.751427] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.751575] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.751653] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.751803] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.751890] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.751970] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.752149] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-458c7186-d79f-4548-a2a0-95db0abbb880 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.752249] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.752309] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.752487] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.752582] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.752669] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.752726] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.752857] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.752978] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.753015] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.753096] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('458c7186-d79f-4548-a2a0-95db0abbb880',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.012415] env[69506]: INFO networking_nsxv3.common.synchronization [req-dcfdc3cc-dc42-4d21-a847-5b4b866c4e05 req-b3f5936c-71c7-4e64-8e45-e190dcaffce9 tempest-VolumesAdminNegativeTest-1438419906 tempest-VolumesAdminNegativeTest-1438419906-project-member] Enqueued Resource ID: 1bceaf9d-1c44-4281-83d2-4109ac0771c7 with Priority: HIGHEST for action security_group_members [ 895.012930] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bceaf9d-1c44-4281-83d2-4109ac0771c7 with Priority: HIGHEST for action security_group_members [ 895.013251] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bceaf9d-1c44-4281-83d2-4109ac0771c7 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.013402] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.013476] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.013678] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.013835] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.013935] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.013996] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.014191] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.014236] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.014328] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bceaf9d-1c44-4281-83d2-4109ac0771c7',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.255162] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 458c7186-d79f-4548-a2a0-95db0abbb880: rpc.has_security_group_logging(os_id): False [ 895.274042] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.274192] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.274242] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.274459] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.274550] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.274770] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.274870] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.274931] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.275088] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.275171] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.275377] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.275474] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.275536] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.275676] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.275750] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.276035] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.279679] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.279749] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.279903] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.279985] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.280090] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 458c7186-d79f-4548-a2a0-95db0abbb880 is going to be created. [ 895.335305] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.335460] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.335534] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.335756] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.335948] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.345754] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 458c7186-d79f-4548-a2a0-95db0abbb880 in Status: IN_PROGRESS for 2s [ 895.517281] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.517281] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.517281] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.518080] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.518080] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.518080] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.518080] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.518080] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.518328] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.518328] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.518328] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bceaf9d-1c44-4281-83d2-4109ac0771c7 is going to be updated. [ 895.547310] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.547453] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.547524] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.547729] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.547868] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.556200] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bceaf9d-1c44-4281-83d2-4109ac0771c7 in Status: IN_PROGRESS for 2s [ 896.860550] env[69506]: INFO networking_nsxv3.common.synchronization [None req-d1f0b191-4701-4606-9b98-c6fc3dd23f68 tempest-ServerDiskConfigTestJSON-583020681 tempest-ServerDiskConfigTestJSON-583020681-project-member] Enqueued Resource ID: 58341f39-ac7f-46a8-aee7-3e6e80f80404 with Priority: HIGHEST for action security_group_rules [ 896.861090] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58341f39-ac7f-46a8-aee7-3e6e80f80404 with Priority: HIGHEST for action security_group_rules [ 896.861423] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58341f39-ac7f-46a8-aee7-3e6e80f80404 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.861729] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58341f39-ac7f-46a8-aee7-3e6e80f80404" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.861729] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58341f39-ac7f-46a8-aee7-3e6e80f80404" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.861816] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58341f39-ac7f-46a8-aee7-3e6e80f80404" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.861903] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58341f39-ac7f-46a8-aee7-3e6e80f80404',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.942409] env[69506]: INFO networking_nsxv3.common.synchronization [None req-3eb2a4bf-175f-491d-9164-d48340e0e269 tempest-ServerDiskConfigTestJSON-583020681 tempest-ServerDiskConfigTestJSON-583020681-project-member] Enqueued Resource ID: 58341f39-ac7f-46a8-aee7-3e6e80f80404 with Priority: HIGHEST for action security_group_rules [ 896.942883] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58341f39-ac7f-46a8-aee7-3e6e80f80404 with Priority: HIGHEST for action security_group_rules [ 896.943189] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58341f39-ac7f-46a8-aee7-3e6e80f80404 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.943293] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58341f39-ac7f-46a8-aee7-3e6e80f80404" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.357618] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 458c7186-d79f-4548-a2a0-95db0abbb880 in Status: SUCCESS [ 897.357859] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.358034] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.358265] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.358358] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('458c7186-d79f-4548-a2a0-95db0abbb880',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.390343] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.390493] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.390556] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.390799] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.390861] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.390941] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58341f39-ac7f-46a8-aee7-3e6e80f80404 already deleted. [ 897.391034] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58341f39-ac7f-46a8-aee7-3e6e80f80404" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.391174] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58341f39-ac7f-46a8-aee7-3e6e80f80404" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.391323] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58341f39-ac7f-46a8-aee7-3e6e80f80404" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.391407] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58341f39-ac7f-46a8-aee7-3e6e80f80404',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.565037] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bceaf9d-1c44-4281-83d2-4109ac0771c7 in Status: SUCCESS [ 897.565234] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bceaf9d-1c44-4281-83d2-4109ac0771c7 deletion is rescheduled due to dependency. [ 897.565352] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.860691] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-458c7186-d79f-4548-a2a0-95db0abbb880 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.860953] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.861085] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.861328] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.861509] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.861611] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.861686] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.861825] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.861913] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.862010] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.862105] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('458c7186-d79f-4548-a2a0-95db0abbb880',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.910851] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.911012] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.911092] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.911309] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.911394] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.911496] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58341f39-ac7f-46a8-aee7-3e6e80f80404 already deleted. [ 897.911578] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58341f39-ac7f-46a8-aee7-3e6e80f80404" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.364341] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-458c7186-d79f-4548-a2a0-95db0abbb880 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.364513] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.364554] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.364790] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.364977] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.365101] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.365179] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.365344] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.365452] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.365544] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.365789] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-458c7186-d79f-4548-a2a0-95db0abbb880 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.365893] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.365893] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.366058] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.366208] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.366302] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.366376] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.366516] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.366599] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.366688] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.366777] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('458c7186-d79f-4548-a2a0-95db0abbb880',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.869722] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 458c7186-d79f-4548-a2a0-95db0abbb880: rpc.has_security_group_logging(os_id): False [ 898.888758] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.888908] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.888959] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.889225] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.889302] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.889528] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.889632] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.889696] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.889856] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.889934] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.890130] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.890228] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.890307] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.890446] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.890522] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.890693] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.890784] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.890843] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.890976] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.891061] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.891145] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 458c7186-d79f-4548-a2a0-95db0abbb880 is going to be updated. [ 898.951088] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.951318] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.951399] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.951617] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.951758] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.962190] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 458c7186-d79f-4548-a2a0-95db0abbb880 in Status: IN_PROGRESS for 2s [ 900.488200] env[69506]: INFO networking_nsxv3.common.synchronization [req-e6958502-2c89-4a97-9d33-20a2a9f4dfdb req-19a22f41-b408-4b9a-8092-7450abd6020f tempest-ServerDiskConfigTestJSON-583020681 tempest-ServerDiskConfigTestJSON-583020681-project-member] Enqueued Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_members [ 900.488861] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_members [ 900.489444] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-008501d4-938b-4336-9c1d-ef3665f7d09d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.489607] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.489701] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.489942] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.490113] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.490213] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.490290] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.490419] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.490503] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.490596] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.978092] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 458c7186-d79f-4548-a2a0-95db0abbb880 in Status: SUCCESS [ 900.978324] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.992997] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.993187] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.993247] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.993476] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.012375] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.012821] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.013048] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.013198] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.013455] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.013591] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.013941] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 008501d4-938b-4336-9c1d-ef3665f7d09d is going to be updated. [ 901.041230] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.041230] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.041230] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.041344] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.042374] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.051467] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 008501d4-938b-4336-9c1d-ef3665f7d09d in Status: IN_PROGRESS for 2s [ 901.609832] env[69506]: INFO networking_nsxv3.common.synchronization [req-71fdfb81-89e1-4316-bec4-a2c173db4a5f req-5f037fd6-1e0d-47f8-ba75-187911d3f6af tempest-ServersAdminTestJSON-446545879 tempest-ServersAdminTestJSON-446545879-project-member] Enqueued Resource ID: 706a5462-e893-428d-beb2-737cbec00439 with Priority: HIGHEST for action security_group_members [ 901.611060] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 706a5462-e893-428d-beb2-737cbec00439 with Priority: HIGHEST for action security_group_members [ 901.611154] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-706a5462-e893-428d-beb2-737cbec00439 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.611222] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.611910] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.611910] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.611910] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.611910] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.611910] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.611910] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.612186] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.612186] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.115309] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.618028] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.062312] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 008501d4-938b-4336-9c1d-ef3665f7d09d in Status: SUCCESS [ 903.062591] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 008501d4-938b-4336-9c1d-ef3665f7d09d deletion is rescheduled due to dependency. [ 903.062655] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.120473] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.120774] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.120941] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.121115] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.121202] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.121310] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 706a5462-e893-428d-beb2-737cbec00439 is going to be updated. [ 903.147714] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.147896] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.147896] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.148142] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.148277] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.155840] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 706a5462-e893-428d-beb2-737cbec00439 in Status: IN_PROGRESS for 2s [ 905.166341] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 706a5462-e893-428d-beb2-737cbec00439 in Status: SUCCESS [ 905.166582] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.611853] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 906.612140] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 909.015315] env[69506]: INFO networking_nsxv3.common.synchronization [None req-81682d06-8f8e-46df-a5b7-90f5fe6dd436 None None] Enqueued Resource ID: 9a8feea7-8929-4b7d-aa5f-294bb922d184 with Priority: HIGHEST for action port [ 909.016092] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a8feea7-8929-4b7d-aa5f-294bb922d184 with Priority: HIGHEST for action port [ 909.016473] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a8feea7-8929-4b7d-aa5f-294bb922d184 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.016622] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a8feea7-8929-4b7d-aa5f-294bb922d184" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.016692] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a8feea7-8929-4b7d-aa5f-294bb922d184" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.016982] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a8feea7-8929-4b7d-aa5f-294bb922d184" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.019226] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a8feea7-8929-4b7d-aa5f-294bb922d184',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.523040] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9a8feea7-8929-4b7d-aa5f-294bb922d184 [ 909.524166] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.524339] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.524382] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.525166] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.525166] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.525166] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9a8feea7-8929-4b7d-aa5f-294bb922d184 already deleted. [ 909.525166] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a8feea7-8929-4b7d-aa5f-294bb922d184" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.018451] env[69506]: INFO networking_nsxv3.common.synchronization [None req-e6bc5d25-6a68-4ec1-99af-825063ff4dda None None] Enqueued Resource ID: 63b81145-a253-4cc1-bc29-a1a1e5e7d2f5 with Priority: HIGHEST for action port [ 911.019162] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63b81145-a253-4cc1-bc29-a1a1e5e7d2f5 with Priority: HIGHEST for action port [ 911.019572] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-63b81145-a253-4cc1-bc29-a1a1e5e7d2f5 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.019694] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63b81145-a253-4cc1-bc29-a1a1e5e7d2f5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.019769] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63b81145-a253-4cc1-bc29-a1a1e5e7d2f5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.020045] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63b81145-a253-4cc1-bc29-a1a1e5e7d2f5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.020127] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63b81145-a253-4cc1-bc29-a1a1e5e7d2f5',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.450141] env[69506]: INFO networking_nsxv3.common.synchronization [None req-cab15489-d362-481e-9aab-c2ff181e7eb8 None None] Enqueued Resource ID: 56bf6d73-1f67-442f-a7ca-44ad6b098f90 with Priority: HIGHEST for action port [ 911.450141] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56bf6d73-1f67-442f-a7ca-44ad6b098f90 with Priority: HIGHEST for action port [ 911.450141] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-56bf6d73-1f67-442f-a7ca-44ad6b098f90 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.450141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56bf6d73-1f67-442f-a7ca-44ad6b098f90" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.451792] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56bf6d73-1f67-442f-a7ca-44ad6b098f90" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.451792] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56bf6d73-1f67-442f-a7ca-44ad6b098f90" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.452159] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56bf6d73-1f67-442f-a7ca-44ad6b098f90',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.526779] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 63b81145-a253-4cc1-bc29-a1a1e5e7d2f5 [ 911.527077] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.527489] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.527594] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.527800] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.527884] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.527980] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:63b81145-a253-4cc1-bc29-a1a1e5e7d2f5 already deleted. [ 911.528075] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63b81145-a253-4cc1-bc29-a1a1e5e7d2f5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.955823] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 56bf6d73-1f67-442f-a7ca-44ad6b098f90 [ 911.955866] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.956045] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.956045] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.956272] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.956372] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.956476] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:56bf6d73-1f67-442f-a7ca-44ad6b098f90 already deleted. [ 911.956559] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56bf6d73-1f67-442f-a7ca-44ad6b098f90" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.178597] env[69506]: INFO networking_nsxv3.common.synchronization [None req-279f698c-2525-4ab5-9091-753557a0361a None None] Enqueued Resource ID: aaa4bd48-ce00-425d-aad8-8de9f4b60dce with Priority: HIGHEST for action port [ 912.179065] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaa4bd48-ce00-425d-aad8-8de9f4b60dce with Priority: HIGHEST for action port [ 912.179397] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-aaa4bd48-ce00-425d-aad8-8de9f4b60dce taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.179630] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aaa4bd48-ce00-425d-aad8-8de9f4b60dce" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.179630] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aaa4bd48-ce00-425d-aad8-8de9f4b60dce" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.179818] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aaa4bd48-ce00-425d-aad8-8de9f4b60dce" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.180123] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aaa4bd48-ce00-425d-aad8-8de9f4b60dce',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.616572] env[69506]: INFO networking_nsxv3.common.synchronization [None req-9167be7e-9919-4b4a-8025-63f1fbd0f58c tempest-ServersV294TestFqdnHostnames-1239405206 tempest-ServersV294TestFqdnHostnames-1239405206-project-member] Enqueued Resource ID: cb920054-1c0f-4a74-aad1-8ca7ce036993 with Priority: HIGHEST for action security_group_rules [ 912.617094] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb920054-1c0f-4a74-aad1-8ca7ce036993 with Priority: HIGHEST for action security_group_rules [ 912.617401] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb920054-1c0f-4a74-aad1-8ca7ce036993 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.617524] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb920054-1c0f-4a74-aad1-8ca7ce036993" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.617664] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb920054-1c0f-4a74-aad1-8ca7ce036993" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.617843] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb920054-1c0f-4a74-aad1-8ca7ce036993" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.617926] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb920054-1c0f-4a74-aad1-8ca7ce036993',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.683447] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aaa4bd48-ce00-425d-aad8-8de9f4b60dce [ 912.684434] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.684592] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.684670] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.684889] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.684982] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.685097] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aaa4bd48-ce00-425d-aad8-8de9f4b60dce already deleted. [ 912.685182] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aaa4bd48-ce00-425d-aad8-8de9f4b60dce" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.703082] env[69506]: INFO networking_nsxv3.common.synchronization [None req-e4dd7bde-fd99-4a1a-9de4-778db68a8622 tempest-ServersV294TestFqdnHostnames-1239405206 tempest-ServersV294TestFqdnHostnames-1239405206-project-member] Enqueued Resource ID: cb920054-1c0f-4a74-aad1-8ca7ce036993 with Priority: HIGHEST for action security_group_rules [ 912.703688] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb920054-1c0f-4a74-aad1-8ca7ce036993 with Priority: HIGHEST for action security_group_rules [ 912.704460] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb920054-1c0f-4a74-aad1-8ca7ce036993 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.704647] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb920054-1c0f-4a74-aad1-8ca7ce036993" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.037402] env[69506]: INFO networking_nsxv3.common.synchronization [None req-c5e63cbe-d50b-4bc6-afaa-fd98c9ba713d None None] Enqueued Resource ID: 03199ef0-b141-4c3b-862b-764af977c4ad with Priority: HIGHEST for action port [ 913.037652] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03199ef0-b141-4c3b-862b-764af977c4ad with Priority: HIGHEST for action port [ 913.037907] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-03199ef0-b141-4c3b-862b-764af977c4ad taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.038916] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03199ef0-b141-4c3b-862b-764af977c4ad" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.038916] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03199ef0-b141-4c3b-862b-764af977c4ad" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.038916] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03199ef0-b141-4c3b-862b-764af977c4ad" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.038916] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03199ef0-b141-4c3b-862b-764af977c4ad',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.043665] env[69506]: INFO networking_nsxv3.common.synchronization [req-c0d3cdd7-fd6e-49d4-ae80-f60c75073e9e req-bb170066-02d3-41ba-ba25-1c12e35c082f tempest-MigrationsAdminTest-625008670 tempest-MigrationsAdminTest-625008670-project-member] Enqueued Resource ID: 0745f36a-3469-4c49-9c0f-8111fe1bd802 with Priority: HIGHEST for action security_group_members [ 913.043899] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0745f36a-3469-4c49-9c0f-8111fe1bd802 with Priority: HIGHEST for action security_group_members [ 913.044586] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0745f36a-3469-4c49-9c0f-8111fe1bd802 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.045169] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.045169] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.045169] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.045169] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.045366] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.045366] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.045503] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.045503] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.045560] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0745f36a-3469-4c49-9c0f-8111fe1bd802',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.145357] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.145357] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.145357] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.145357] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.145357] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.145357] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb920054-1c0f-4a74-aad1-8ca7ce036993 already deleted. [ 913.145357] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb920054-1c0f-4a74-aad1-8ca7ce036993" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.145357] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb920054-1c0f-4a74-aad1-8ca7ce036993" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.145357] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb920054-1c0f-4a74-aad1-8ca7ce036993" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.145357] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb920054-1c0f-4a74-aad1-8ca7ce036993',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.542069] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 03199ef0-b141-4c3b-862b-764af977c4ad [ 913.542321] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.542441] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.542550] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.542768] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.542858] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.542955] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:03199ef0-b141-4c3b-862b-764af977c4ad already deleted. [ 913.543048] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03199ef0-b141-4c3b-862b-764af977c4ad" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.552033] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0745f36a-3469-4c49-9c0f-8111fe1bd802',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.670525] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.670699] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.670771] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.670955] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.671059] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.671162] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb920054-1c0f-4a74-aad1-8ca7ce036993 already deleted. [ 913.671244] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb920054-1c0f-4a74-aad1-8ca7ce036993" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.056432] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0745f36a-3469-4c49-9c0f-8111fe1bd802',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.558685] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.562488] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.562488] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.562488] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.562488] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.562488] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0745f36a-3469-4c49-9c0f-8111fe1bd802 is going to be updated. [ 914.588236] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.588236] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.588236] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.588236] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.588236] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.595997] env[69506]: INFO networking_nsxv3.common.synchronization [None req-6e48e2ba-8bb8-4b59-9158-9f3c20b03ff1 None None] Enqueued Resource ID: db6bc328-c11a-41c1-9221-cee4f46f7dbe with Priority: HIGHEST for action port [ 914.598422] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0745f36a-3469-4c49-9c0f-8111fe1bd802 in Status: IN_PROGRESS for 2s [ 914.598871] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db6bc328-c11a-41c1-9221-cee4f46f7dbe with Priority: HIGHEST for action port [ 914.599285] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-db6bc328-c11a-41c1-9221-cee4f46f7dbe taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.599391] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db6bc328-c11a-41c1-9221-cee4f46f7dbe" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.599490] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db6bc328-c11a-41c1-9221-cee4f46f7dbe" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.599663] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db6bc328-c11a-41c1-9221-cee4f46f7dbe" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.599738] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db6bc328-c11a-41c1-9221-cee4f46f7dbe',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.101545] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db6bc328-c11a-41c1-9221-cee4f46f7dbe [ 915.102056] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.103693] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.103693] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.103693] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.103693] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.103693] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db6bc328-c11a-41c1-9221-cee4f46f7dbe already deleted. [ 915.103693] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db6bc328-c11a-41c1-9221-cee4f46f7dbe" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.608129] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0745f36a-3469-4c49-9c0f-8111fe1bd802 in Status: SUCCESS [ 916.608396] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.540027] env[69506]: INFO networking_nsxv3.common.synchronization [req-4ed40913-ec1d-426e-bebd-81dac50b4f84 req-3f685a6c-c1ec-4881-bce9-23785f3a40b8 tempest-ImagesTestJSON-821230832 tempest-ImagesTestJSON-821230832-project-member] Enqueued Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_members [ 917.540027] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_members [ 917.540027] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0db323-2ed4-4f6a-a30a-405b16133cb2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.540027] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.540027] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.540027] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.540566] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.540566] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.540566] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.540566] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.540727] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.542037] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.930330] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-612 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.930866] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-612" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.930866] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-612" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.930866] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-612" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.931186] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.931302] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.931382] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.931626] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.931866] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.932031] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 917.932212] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 917.932287] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 917.932394] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 917.932694] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 917.932694] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 917.932804] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 917.950253] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 917.950436] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 917.950608] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 917.950790] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-612" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.951111] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-26f093fd-4757-421f-a19a-00b9b0ee27b4 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.951366] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-26f093fd-4757-421f-a19a-00b9b0ee27b4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.951467] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-26f093fd-4757-421f-a19a-00b9b0ee27b4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.951778] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-26f093fd-4757-421f-a19a-00b9b0ee27b4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.951922] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26f093fd-4757-421f-a19a-00b9b0ee27b4',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.043845] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.455057] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.455057] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.455057] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.455340] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.455499] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.455668] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 26f093fd-4757-421f-a19a-00b9b0ee27b4 not found, creating... [ 918.456161] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.456391] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.456553] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.456795] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.456959] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.457270] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.457446] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.457579] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.457791] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.457931] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.458087] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 26f093fd-4757-421f-a19a-00b9b0ee27b4 is going to be created. [ 918.546108] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.549294] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.549578] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.549725] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.550014] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.550349] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.550651] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-26f093fd-4757-421f-a19a-00b9b0ee27b4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.048881] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.049248] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.049248] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.049340] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.049558] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.049679] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 is going to be updated. [ 919.092171] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.092314] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.092376] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.092589] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.092725] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.102113] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: IN_PROGRESS for 2s [ 919.207100] env[69506]: INFO networking_nsxv3.common.synchronization [req-4ed40913-ec1d-426e-bebd-81dac50b4f84 req-03a0df86-f3e7-4696-a9af-02f6f68faa1f service nova] Enqueued Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_rules [ 919.207386] env[69506]: INFO networking_nsxv3.common.synchronization [req-4ed40913-ec1d-426e-bebd-81dac50b4f84 req-03a0df86-f3e7-4696-a9af-02f6f68faa1f service nova] Enqueued Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_members [ 919.207545] env[69506]: INFO networking_nsxv3.common.synchronization [req-4ed40913-ec1d-426e-bebd-81dac50b4f84 req-03a0df86-f3e7-4696-a9af-02f6f68faa1f service nova] Enqueued Resource ID: 26f093fd-4757-421f-a19a-00b9b0ee27b4 with Priority: HIGHEST for action port [ 919.207780] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_rules [ 919.207909] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_members [ 919.208013] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26f093fd-4757-421f-a19a-00b9b0ee27b4 with Priority: HIGHEST for action port [ 919.208565] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d0db323-2ed4-4f6a-a30a-405b16133cb2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.208699] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.208766] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.208969] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.209070] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.209984] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0db323-2ed4-4f6a-a30a-405b16133cb2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.210093] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.210356] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-26f093fd-4757-421f-a19a-00b9b0ee27b4 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.210486] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26f093fd-4757-421f-a19a-00b9b0ee27b4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.210570] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26f093fd-4757-421f-a19a-00b9b0ee27b4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.210789] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26f093fd-4757-421f-a19a-00b9b0ee27b4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.210896] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26f093fd-4757-421f-a19a-00b9b0ee27b4',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.712929] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0db323-2ed4-4f6a-a30a-405b16133cb2 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.713149] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.713394] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 26f093fd-4757-421f-a19a-00b9b0ee27b4 with status ACTIVE [ 919.713629] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.713847] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.714010] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.714261] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.714382] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.714604] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.714755] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.714838] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.715033] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.715161] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.715385] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.715518] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.715591] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.715776] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.715876] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.716222] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 26f093fd-4757-421f-a19a-00b9b0ee27b4 is going to be updated. [ 919.735983] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.736167] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.736241] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.736613] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.736759] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.736928] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26f093fd-4757-421f-a19a-00b9b0ee27b4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.112031] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: IN_PROGRESS for 4s [ 923.124481] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: SUCCESS [ 923.124777] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.124841] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.125063] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.125244] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.125356] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.125418] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.125559] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.125638] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.125730] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.628580] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.131141] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.209454] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 924.209608] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 924.634603] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.638017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.638017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.638017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.638017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.638017] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 is going to be updated. [ 924.662053] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.662211] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.662283] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.662500] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.662642] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.671120] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: IN_PROGRESS for 2s [ 925.282725] env[69506]: INFO networking_nsxv3.common.synchronization [req-40cb5361-62c6-41a7-b694-73bde6ec79cb req-cef4f43f-9b77-42fa-ace4-cab6972c7a22 tempest-ServerRescueNegativeTestJSON-1844285858 tempest-ServerRescueNegativeTestJSON-1844285858-project-member] Enqueued Resource ID: 20940711-36df-48c2-b8ae-df2cfecaebc8 with Priority: HIGHEST for action security_group_members [ 925.283309] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20940711-36df-48c2-b8ae-df2cfecaebc8 with Priority: HIGHEST for action security_group_members [ 925.283630] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-20940711-36df-48c2-b8ae-df2cfecaebc8 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.283757] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20940711-36df-48c2-b8ae-df2cfecaebc8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.283842] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20940711-36df-48c2-b8ae-df2cfecaebc8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.284122] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20940711-36df-48c2-b8ae-df2cfecaebc8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.284288] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.284388] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.284452] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.284623] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.284709] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.284807] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20940711-36df-48c2-b8ae-df2cfecaebc8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.616329] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-727 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.616537] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-727" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.616603] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-727" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.616883] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-727" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.617161] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.617340] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.617481] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.617703] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.617852] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.618455] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 925.619086] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 925.619086] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 925.619086] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 925.619086] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 925.619236] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 925.619468] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 925.636968] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 925.637381] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 925.637586] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 925.638334] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-727" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.638733] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-3edbbd59-9a3a-48c7-864c-c39d8ae0b9f2 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.639070] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-3edbbd59-9a3a-48c7-864c-c39d8ae0b9f2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.639275] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-3edbbd59-9a3a-48c7-864c-c39d8ae0b9f2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.639704] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-3edbbd59-9a3a-48c7-864c-c39d8ae0b9f2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.639910] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3edbbd59-9a3a-48c7-864c-c39d8ae0b9f2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.789033] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.789033] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.789033] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.789033] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.789033] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.789033] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.789033] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.789033] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.789033] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.789033] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.789033] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20940711-36df-48c2-b8ae-df2cfecaebc8 already deleted. [ 925.789033] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20940711-36df-48c2-b8ae-df2cfecaebc8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.143910] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.144242] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.144433] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.144893] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.145207] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.145476] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 3edbbd59-9a3a-48c7-864c-c39d8ae0b9f2 not found, creating... [ 926.145813] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.146064] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.146411] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.146875] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.146983] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.147453] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.147654] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.147833] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.148316] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.148509] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.148635] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 3edbbd59-9a3a-48c7-864c-c39d8ae0b9f2 is going to be created. [ 926.168484] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.169151] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.169361] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.170219] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.170637] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.171048] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-3edbbd59-9a3a-48c7-864c-c39d8ae0b9f2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.293626] env[69506]: INFO networking_nsxv3.common.synchronization [None req-a20635fe-ef95-4a34-a647-904e6646a9fa None None] Enqueued Resource ID: 42424bb9-5e49-4e48-a54f-bf49a1e49424 with Priority: HIGHEST for action port [ 926.294423] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42424bb9-5e49-4e48-a54f-bf49a1e49424 with Priority: HIGHEST for action port [ 926.297456] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-42424bb9-5e49-4e48-a54f-bf49a1e49424 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.297680] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42424bb9-5e49-4e48-a54f-bf49a1e49424" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.297864] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42424bb9-5e49-4e48-a54f-bf49a1e49424" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.298192] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42424bb9-5e49-4e48-a54f-bf49a1e49424" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.298317] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42424bb9-5e49-4e48-a54f-bf49a1e49424',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.693376] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: SUCCESS [ 926.693606] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.693794] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.694013] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.694239] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.694360] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.694427] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.694589] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.694676] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.694763] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.694856] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.804019] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 42424bb9-5e49-4e48-a54f-bf49a1e49424 [ 926.804019] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.804019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.804019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.804019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.804019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.804019] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:42424bb9-5e49-4e48-a54f-bf49a1e49424 already deleted. [ 926.804019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42424bb9-5e49-4e48-a54f-bf49a1e49424" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.899620] env[69506]: INFO networking_nsxv3.common.synchronization [req-40cb5361-62c6-41a7-b694-73bde6ec79cb req-d9109434-afbd-467a-8b6d-0699467ee0bb service nova] Enqueued Resource ID: 20940711-36df-48c2-b8ae-df2cfecaebc8 with Priority: HIGHEST for action security_group_rules [ 926.900387] env[69506]: INFO networking_nsxv3.common.synchronization [req-40cb5361-62c6-41a7-b694-73bde6ec79cb req-d9109434-afbd-467a-8b6d-0699467ee0bb service nova] Enqueued Resource ID: 20940711-36df-48c2-b8ae-df2cfecaebc8 with Priority: HIGHEST for action security_group_members [ 926.900387] env[69506]: INFO networking_nsxv3.common.synchronization [req-40cb5361-62c6-41a7-b694-73bde6ec79cb req-d9109434-afbd-467a-8b6d-0699467ee0bb service nova] Enqueued Resource ID: 3edbbd59-9a3a-48c7-864c-c39d8ae0b9f2 with Priority: HIGHEST for action port [ 926.901148] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20940711-36df-48c2-b8ae-df2cfecaebc8 with Priority: HIGHEST for action security_group_rules [ 926.901148] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20940711-36df-48c2-b8ae-df2cfecaebc8 with Priority: HIGHEST for action security_group_members [ 926.901148] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3edbbd59-9a3a-48c7-864c-c39d8ae0b9f2 with Priority: HIGHEST for action port [ 926.901511] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20940711-36df-48c2-b8ae-df2cfecaebc8 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.901511] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20940711-36df-48c2-b8ae-df2cfecaebc8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.901606] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20940711-36df-48c2-b8ae-df2cfecaebc8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.903056] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20940711-36df-48c2-b8ae-df2cfecaebc8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.903056] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20940711-36df-48c2-b8ae-df2cfecaebc8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.904107] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-20940711-36df-48c2-b8ae-df2cfecaebc8 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.904253] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20940711-36df-48c2-b8ae-df2cfecaebc8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.904329] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20940711-36df-48c2-b8ae-df2cfecaebc8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.904518] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20940711-36df-48c2-b8ae-df2cfecaebc8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.904704] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.904815] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.904881] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.905075] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.905545] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.905545] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20940711-36df-48c2-b8ae-df2cfecaebc8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.906474] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-3edbbd59-9a3a-48c7-864c-c39d8ae0b9f2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.906609] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3edbbd59-9a3a-48c7-864c-c39d8ae0b9f2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.906667] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3edbbd59-9a3a-48c7-864c-c39d8ae0b9f2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.907107] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3edbbd59-9a3a-48c7-864c-c39d8ae0b9f2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.907107] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3edbbd59-9a3a-48c7-864c-c39d8ae0b9f2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.197974] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0db323-2ed4-4f6a-a30a-405b16133cb2 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.197974] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.197974] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.197974] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.197974] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.197974] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.198345] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.198345] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.198345] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.198345] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.198489] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0db323-2ed4-4f6a-a30a-405b16133cb2 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.198582] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.198642] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.198780] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.198916] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.199014] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.199077] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.199210] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.199284] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.199362] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.199486] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.410516] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3edbbd59-9a3a-48c7-864c-c39d8ae0b9f2 with status ACTIVE [ 927.410516] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.410516] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.410516] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.410516] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.411191] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.411191] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.411191] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.411297] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.411438] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.411485] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.411637] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.411726] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.411783] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.411922] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.411991] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.412840] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3edbbd59-9a3a-48c7-864c-c39d8ae0b9f2 is going to be updated. [ 927.414270] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-20940711-36df-48c2-b8ae-df2cfecaebc8 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.414387] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20940711-36df-48c2-b8ae-df2cfecaebc8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.414605] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('20940711-36df-48c2-b8ae-df2cfecaebc8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.433427] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.433569] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.433638] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.433846] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.433974] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.434152] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3edbbd59-9a3a-48c7-864c-c39d8ae0b9f2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.708429] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d0db323-2ed4-4f6a-a30a-405b16133cb2: rpc.has_security_group_logging(os_id): False [ 927.726316] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.726811] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.726811] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.726811] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.746946] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.748297] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.748297] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.748297] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.748297] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.748297] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.748297] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.748297] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.748297] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.748730] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.748730] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.748730] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.748824] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.748854] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.749372] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.752937] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.753058] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 is going to be updated. [ 927.810725] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.810725] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.810725] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.810725] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.810963] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.824495] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: IN_PROGRESS for 2s [ 927.918574] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('20940711-36df-48c2-b8ae-df2cfecaebc8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.988910] env[69506]: INFO networking_nsxv3.common.synchronization [req-db76f03d-fae3-46d7-951c-b55c4ed2b162 req-7d3ca804-9ea1-4d14-aebf-40cd1bc06ce7 tempest-ServerDiskConfigTestJSON-583020681 tempest-ServerDiskConfigTestJSON-583020681-project-member] Enqueued Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_members [ 927.989717] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_members [ 927.990050] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-008501d4-938b-4336-9c1d-ef3665f7d09d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.990176] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.990241] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.990872] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.991112] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.991321] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.991376] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.991557] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.991603] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.991696] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.421132] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.421440] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.421440] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.422183] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.422183] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.422183] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20940711-36df-48c2-b8ae-df2cfecaebc8 is going to be created. [ 928.448987] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.450431] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.450713] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.450989] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.451423] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.457617] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-350 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.458177] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-350" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.458177] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-350" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.458326] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-350" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.461669] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.461669] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.461669] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.461669] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.461669] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.461669] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 928.461669] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 928.461669] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 928.461669] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 928.461669] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 928.461669] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 928.461669] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 928.465687] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20940711-36df-48c2-b8ae-df2cfecaebc8 in Status: UNINITIALIZED for 2s [ 928.477663] env[69506]: INFO networking_nsxv3.common.synchronization [None req-20b4ded4-f1f2-4d37-8b84-dd546a3fa605 None None] Enqueued Resource ID: 0efc903e-bd86-478c-89c5-5640d08275bd with Priority: HIGHEST for action port [ 928.478432] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0efc903e-bd86-478c-89c5-5640d08275bd with Priority: HIGHEST for action port [ 928.478825] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-0efc903e-bd86-478c-89c5-5640d08275bd taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.478962] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0efc903e-bd86-478c-89c5-5640d08275bd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.479038] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0efc903e-bd86-478c-89c5-5640d08275bd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.479323] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0efc903e-bd86-478c-89c5-5640d08275bd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.479405] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0efc903e-bd86-478c-89c5-5640d08275bd',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.488970] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 928.490019] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 928.490019] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 928.490019] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-350" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.490019] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-d4702c17-7522-49a0-a664-627c0a45dfa1 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.490268] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-d4702c17-7522-49a0-a664-627c0a45dfa1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.490268] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-d4702c17-7522-49a0-a664-627c0a45dfa1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.490521] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-d4702c17-7522-49a0-a664-627c0a45dfa1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.490659] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4702c17-7522-49a0-a664-627c0a45dfa1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.494950] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.499076] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.499076] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.499076] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.499076] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.499076] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.499076] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.499076] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.499076] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.499076] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.499076] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 008501d4-938b-4336-9c1d-ef3665f7d09d is going to be updated. [ 928.528074] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.528235] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.529800] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.529800] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.529800] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.537592] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 008501d4-938b-4336-9c1d-ef3665f7d09d in Status: IN_PROGRESS for 2s [ 928.985776] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0efc903e-bd86-478c-89c5-5640d08275bd [ 928.985776] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.985776] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.985776] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.985776] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.985776] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.985776] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0efc903e-bd86-478c-89c5-5640d08275bd already deleted. [ 928.985776] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0efc903e-bd86-478c-89c5-5640d08275bd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.000883] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.001125] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.001268] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.001564] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.001722] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.001920] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port d4702c17-7522-49a0-a664-627c0a45dfa1 not found, creating... [ 929.003939] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.004200] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.004332] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.004584] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.004758] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.005511] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.005866] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.006007] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.006296] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.006455] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.006611] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: d4702c17-7522-49a0-a664-627c0a45dfa1 is going to be created. [ 929.031447] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.031714] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.031891] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.032186] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.032447] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.032693] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-d4702c17-7522-49a0-a664-627c0a45dfa1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.838215] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: SUCCESS [ 929.838215] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.320219] env[69506]: INFO networking_nsxv3.common.synchronization [req-db76f03d-fae3-46d7-951c-b55c4ed2b162 req-97343c56-a603-40c1-b8ce-ecd1d44ef46e service nova] Enqueued Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_rules [ 930.320375] env[69506]: INFO networking_nsxv3.common.synchronization [req-db76f03d-fae3-46d7-951c-b55c4ed2b162 req-97343c56-a603-40c1-b8ce-ecd1d44ef46e service nova] Enqueued Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_members [ 930.320596] env[69506]: INFO networking_nsxv3.common.synchronization [req-db76f03d-fae3-46d7-951c-b55c4ed2b162 req-97343c56-a603-40c1-b8ce-ecd1d44ef46e service nova] Enqueued Resource ID: d4702c17-7522-49a0-a664-627c0a45dfa1 with Priority: HIGHEST for action port [ 930.321661] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_rules [ 930.321840] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_members [ 930.321964] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4702c17-7522-49a0-a664-627c0a45dfa1 with Priority: HIGHEST for action port [ 930.322294] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-008501d4-938b-4336-9c1d-ef3665f7d09d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.322428] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.322500] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.322713] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.322795] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.323746] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-008501d4-938b-4336-9c1d-ef3665f7d09d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.323847] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.324076] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4702c17-7522-49a0-a664-627c0a45dfa1 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.324164] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4702c17-7522-49a0-a664-627c0a45dfa1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.324212] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4702c17-7522-49a0-a664-627c0a45dfa1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.324391] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4702c17-7522-49a0-a664-627c0a45dfa1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.324469] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4702c17-7522-49a0-a664-627c0a45dfa1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.477199] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20940711-36df-48c2-b8ae-df2cfecaebc8 in Status: SUCCESS [ 930.477423] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20940711-36df-48c2-b8ae-df2cfecaebc8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.477624] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20940711-36df-48c2-b8ae-df2cfecaebc8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.479120] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20940711-36df-48c2-b8ae-df2cfecaebc8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.479316] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.479467] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.479520] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.479658] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.479747] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.479908] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20940711-36df-48c2-b8ae-df2cfecaebc8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.479960] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('20940711-36df-48c2-b8ae-df2cfecaebc8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.546373] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 008501d4-938b-4336-9c1d-ef3665f7d09d in Status: SUCCESS [ 930.546428] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 008501d4-938b-4336-9c1d-ef3665f7d09d deletion is rescheduled due to dependency. [ 930.546523] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.547047] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.547047] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.547047] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.547199] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.547231] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.547738] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.547738] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.547738] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.827188] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-008501d4-938b-4336-9c1d-ef3665f7d09d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.827595] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.827811] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d4702c17-7522-49a0-a664-627c0a45dfa1 with status ACTIVE [ 930.827994] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.828119] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.828186] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.828413] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.828516] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.828663] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.828759] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.828821] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.828968] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.829058] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.829241] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.829331] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.829392] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.829581] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.829654] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.829740] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d4702c17-7522-49a0-a664-627c0a45dfa1 is going to be updated. [ 930.853130] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.853432] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.853432] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.853566] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.853683] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.853865] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4702c17-7522-49a0-a664-627c0a45dfa1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.982495] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('20940711-36df-48c2-b8ae-df2cfecaebc8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.050019] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.485025] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 20940711-36df-48c2-b8ae-df2cfecaebc8: rpc.has_security_group_logging(os_id): False [ 931.503196] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.503391] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.503430] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.503634] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.503715] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.503966] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.504544] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.504544] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.504544] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.504544] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.504544] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20940711-36df-48c2-b8ae-df2cfecaebc8 is going to be created. [ 931.553345] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.558869] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.559014] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.559085] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.559292] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.559593] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.569795] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20940711-36df-48c2-b8ae-df2cfecaebc8 in Status: IN_PROGRESS for 2s [ 932.055817] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.056213] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.056213] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.056435] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.056617] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.056689] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 008501d4-938b-4336-9c1d-ef3665f7d09d is going to be updated. [ 932.086200] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.086358] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.086428] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.086654] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.086798] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.095127] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 008501d4-938b-4336-9c1d-ef3665f7d09d in Status: IN_PROGRESS for 2s [ 933.121303] env[69506]: INFO networking_nsxv3.common.synchronization [req-1d62dc42-6ceb-4188-a1cf-24c7507824ea req-bd8817d1-98ba-4b6e-a32d-06f5ea1426ac tempest-ServersAdminTestJSON-446545879 tempest-ServersAdminTestJSON-446545879-project-member] Enqueued Resource ID: 706a5462-e893-428d-beb2-737cbec00439 with Priority: HIGHEST for action security_group_members [ 933.121960] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 706a5462-e893-428d-beb2-737cbec00439 with Priority: HIGHEST for action security_group_members [ 933.122283] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-706a5462-e893-428d-beb2-737cbec00439 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.122401] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.122468] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.122670] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.122821] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.122916] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.122979] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.123233] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.123325] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.123419] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.354474] env[69506]: INFO networking_nsxv3.common.synchronization [req-26e5ca36-7c9f-42cd-a1ff-955425efa726 req-7b40e7c2-c25f-468a-8cb8-17b46e4fa799 tempest-ServerRescueTestJSONUnderV235-927744761 tempest-ServerRescueTestJSONUnderV235-927744761-project-member] Enqueued Resource ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 with Priority: HIGHEST for action security_group_members [ 933.355236] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 with Priority: HIGHEST for action security_group_members [ 933.355327] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c0ce237-8ae5-4e9f-857a-af422cd22902 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.355454] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.355519] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.355769] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.355933] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.356481] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.356567] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.356735] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.356824] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.356950] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c0ce237-8ae5-4e9f-857a-af422cd22902',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.583601] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20940711-36df-48c2-b8ae-df2cfecaebc8 in Status: SUCCESS [ 933.583820] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20940711-36df-48c2-b8ae-df2cfecaebc8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.628390] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.775847] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-53 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.776069] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-53" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.776216] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-53" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.777286] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-53" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.777592] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.777788] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.777981] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.778300] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.778674] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.778797] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 933.778952] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 933.779126] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 933.779266] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 933.779422] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 933.779578] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 933.779775] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 933.805053] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 933.805053] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 933.805053] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 933.805053] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-53" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.805053] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-b4d0ef17-87ed-494d-94b1-bf5678c7dbd4 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.805053] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-b4d0ef17-87ed-494d-94b1-bf5678c7dbd4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.805053] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-b4d0ef17-87ed-494d-94b1-bf5678c7dbd4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.805053] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-b4d0ef17-87ed-494d-94b1-bf5678c7dbd4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.805053] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4d0ef17-87ed-494d-94b1-bf5678c7dbd4',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.862273] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.862273] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.862273] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.862273] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.862273] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.862273] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.862273] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.862273] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.862273] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.862273] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.862273] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 already deleted. [ 933.862273] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.104771] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 008501d4-938b-4336-9c1d-ef3665f7d09d in Status: IN_PROGRESS for 4s [ 934.131083] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.244344] env[69506]: INFO networking_nsxv3.common.synchronization [None req-d0148e35-c323-4a8e-80dc-0b66a5bc949b None None] Enqueued Resource ID: 9e843dd5-7ee7-440d-bced-6164d64f4ee2 with Priority: HIGHEST for action port [ 934.244505] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e843dd5-7ee7-440d-bced-6164d64f4ee2 with Priority: HIGHEST for action port [ 934.245203] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e843dd5-7ee7-440d-bced-6164d64f4ee2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.245329] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e843dd5-7ee7-440d-bced-6164d64f4ee2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.245392] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e843dd5-7ee7-440d-bced-6164d64f4ee2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.245643] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e843dd5-7ee7-440d-bced-6164d64f4ee2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.245808] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e843dd5-7ee7-440d-bced-6164d64f4ee2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.311875] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.311875] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.311875] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.312097] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.312865] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.312865] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port b4d0ef17-87ed-494d-94b1-bf5678c7dbd4 not found, creating... [ 934.312865] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.312865] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.313204] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.313204] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.313296] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.313650] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.313805] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.313923] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.314152] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.314470] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.314470] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: b4d0ef17-87ed-494d-94b1-bf5678c7dbd4 is going to be created. [ 934.335842] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.335842] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.335842] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.335842] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.336017] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.336212] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-b4d0ef17-87ed-494d-94b1-bf5678c7dbd4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.633923] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.634049] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.638024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.638024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.638024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.638024] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 706a5462-e893-428d-beb2-737cbec00439 is going to be updated. [ 934.661458] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.661458] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.661458] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.661807] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.661807] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.671020] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 706a5462-e893-428d-beb2-737cbec00439 in Status: IN_PROGRESS for 2s [ 934.750362] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9e843dd5-7ee7-440d-bced-6164d64f4ee2 [ 934.750362] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.750362] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.750362] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.750362] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.750362] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.750835] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9e843dd5-7ee7-440d-bced-6164d64f4ee2 already deleted. [ 934.751218] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e843dd5-7ee7-440d-bced-6164d64f4ee2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.212842] env[69506]: INFO networking_nsxv3.common.synchronization [req-26e5ca36-7c9f-42cd-a1ff-955425efa726 req-74e08718-e635-46ae-abd4-673029011cfc service nova] Enqueued Resource ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 with Priority: HIGHEST for action security_group_rules [ 935.212842] env[69506]: INFO networking_nsxv3.common.synchronization [req-26e5ca36-7c9f-42cd-a1ff-955425efa726 req-74e08718-e635-46ae-abd4-673029011cfc service nova] Enqueued Resource ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 with Priority: HIGHEST for action security_group_members [ 935.212842] env[69506]: INFO networking_nsxv3.common.synchronization [req-26e5ca36-7c9f-42cd-a1ff-955425efa726 req-74e08718-e635-46ae-abd4-673029011cfc service nova] Enqueued Resource ID: b4d0ef17-87ed-494d-94b1-bf5678c7dbd4 with Priority: HIGHEST for action port [ 935.212842] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 with Priority: HIGHEST for action security_group_rules [ 935.212842] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 with Priority: HIGHEST for action security_group_members [ 935.212842] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d0ef17-87ed-494d-94b1-bf5678c7dbd4 with Priority: HIGHEST for action port [ 935.213285] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c0ce237-8ae5-4e9f-857a-af422cd22902 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.213416] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.213485] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.213747] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.213830] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c0ce237-8ae5-4e9f-857a-af422cd22902',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.215017] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c0ce237-8ae5-4e9f-857a-af422cd22902 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.215017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.215017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.215148] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.215214] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.215316] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.215388] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.215535] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.215625] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.215734] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c0ce237-8ae5-4e9f-857a-af422cd22902',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.216441] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4d0ef17-87ed-494d-94b1-bf5678c7dbd4 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.216549] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4d0ef17-87ed-494d-94b1-bf5678c7dbd4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.216802] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4d0ef17-87ed-494d-94b1-bf5678c7dbd4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.216802] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4d0ef17-87ed-494d-94b1-bf5678c7dbd4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.216888] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4d0ef17-87ed-494d-94b1-bf5678c7dbd4',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.545599] env[69506]: INFO networking_nsxv3.common.synchronization [req-c5d2a6fc-fb45-4b09-add2-16376c3934da req-b04de5fa-7685-4349-8e86-b36b148038a0 tempest-InstanceActionsV221TestJSON-1814289415 tempest-InstanceActionsV221TestJSON-1814289415-project-member] Enqueued Resource ID: c0818539-e942-4d2b-a340-3442e08309ce with Priority: HIGHEST for action security_group_members [ 935.546139] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0818539-e942-4d2b-a340-3442e08309ce with Priority: HIGHEST for action security_group_members [ 935.546783] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0818539-e942-4d2b-a340-3442e08309ce taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.546909] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0818539-e942-4d2b-a340-3442e08309ce" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.547010] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0818539-e942-4d2b-a340-3442e08309ce" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.547919] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0818539-e942-4d2b-a340-3442e08309ce" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.548102] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.548238] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.548285] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.548422] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.548509] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.548605] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0818539-e942-4d2b-a340-3442e08309ce',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.719412] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c0ce237-8ae5-4e9f-857a-af422cd22902 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.719558] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.719783] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c0ce237-8ae5-4e9f-857a-af422cd22902',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.722318] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b4d0ef17-87ed-494d-94b1-bf5678c7dbd4 with status ACTIVE [ 935.722776] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.722776] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.722776] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.723849] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.723849] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.723849] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.723849] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.723849] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.723849] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.723849] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.724275] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.724275] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.724275] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.724400] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.724400] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.724460] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b4d0ef17-87ed-494d-94b1-bf5678c7dbd4 is going to be updated. [ 935.744321] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.744454] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.744503] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.744716] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.744856] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.745024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4d0ef17-87ed-494d-94b1-bf5678c7dbd4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.040072] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-414 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.040072] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-414" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.040072] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-414" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.040072] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-414" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.040072] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.040072] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.040317] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.040405] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.040611] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.040866] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 936.041022] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 936.041182] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 936.041308] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 936.041480] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 936.041662] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 936.041822] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 936.052341] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.052341] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.052341] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.052341] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.052341] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.052341] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.052341] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.052341] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.052679] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.052679] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.052679] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0818539-e942-4d2b-a340-3442e08309ce already deleted. [ 936.052679] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0818539-e942-4d2b-a340-3442e08309ce" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.063775] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 936.063775] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 936.063775] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 936.063775] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-414" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.063775] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-27fae32d-5f1c-4278-85b5-4303d9a5eb19 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.063775] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-27fae32d-5f1c-4278-85b5-4303d9a5eb19" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.063775] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-27fae32d-5f1c-4278-85b5-4303d9a5eb19" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.066686] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-27fae32d-5f1c-4278-85b5-4303d9a5eb19" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.066686] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27fae32d-5f1c-4278-85b5-4303d9a5eb19',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.114414] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 008501d4-938b-4336-9c1d-ef3665f7d09d in Status: SUCCESS [ 936.114955] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.116094] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.116094] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.116094] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.116094] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.116094] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.116366] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.116366] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.116553] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.116553] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.221406] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c0ce237-8ae5-4e9f-857a-af422cd22902',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.569856] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.569985] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.570076] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.570482] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.570809] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.570809] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 27fae32d-5f1c-4278-85b5-4303d9a5eb19 not found, creating... [ 936.571062] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.571230] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.571353] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.571591] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.571736] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.573880] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.573880] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.573880] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.574292] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.574489] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.574773] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 27fae32d-5f1c-4278-85b5-4303d9a5eb19 is going to be created. [ 936.597038] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.597272] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.597419] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.597843] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.598092] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.598328] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-27fae32d-5f1c-4278-85b5-4303d9a5eb19" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.619389] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-008501d4-938b-4336-9c1d-ef3665f7d09d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.619622] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.619805] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.620055] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.620266] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.620397] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.620466] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.620640] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.620701] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.620789] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.620938] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-008501d4-938b-4336-9c1d-ef3665f7d09d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.621058] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.621136] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.621271] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.621444] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.621634] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.621711] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.621859] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.621957] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.622445] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.622610] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.680233] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 706a5462-e893-428d-beb2-737cbec00439 in Status: SUCCESS [ 936.680438] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.725675] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.725836] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.726510] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.726510] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.726510] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.726510] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 is going to be created. [ 936.773616] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.773768] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.773849] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.774091] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.774269] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.786084] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 in Status: UNINITIALIZED for 2s [ 936.982638] env[69506]: INFO networking_nsxv3.common.synchronization [None req-82b06eae-cd69-4cce-81a6-28bc3d5880fc None None] Enqueued Resource ID: 2a486daa-61e9-4bbe-aae4-7599fe37c7b6 with Priority: HIGHEST for action port [ 936.985901] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a486daa-61e9-4bbe-aae4-7599fe37c7b6 with Priority: HIGHEST for action port [ 936.986246] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a486daa-61e9-4bbe-aae4-7599fe37c7b6 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.986503] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a486daa-61e9-4bbe-aae4-7599fe37c7b6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.986563] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a486daa-61e9-4bbe-aae4-7599fe37c7b6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.986905] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a486daa-61e9-4bbe-aae4-7599fe37c7b6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.987043] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a486daa-61e9-4bbe-aae4-7599fe37c7b6',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.082750] env[69506]: INFO networking_nsxv3.common.synchronization [req-3efe8181-19f8-4103-a2a3-e3427ddb0a32 req-9978b109-f4ac-49cb-9852-3e2b845c48e7 tempest-ImagesTestJSON-821230832 tempest-ImagesTestJSON-821230832-project-member] Enqueued Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_members [ 937.083483] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_members [ 937.083855] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0db323-2ed4-4f6a-a30a-405b16133cb2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.083973] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.084309] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.084618] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.084789] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.084897] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.084953] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.085130] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.085253] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.085381] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.127058] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 008501d4-938b-4336-9c1d-ef3665f7d09d: rpc.has_security_group_logging(os_id): False [ 937.146244] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.147576] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.147576] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.147576] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.147576] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.147576] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.147576] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.147576] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.147576] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.147576] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.147877] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.147877] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.147944] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.149150] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.149150] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.149150] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.149150] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.149150] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.149150] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.149150] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.149150] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 008501d4-938b-4336-9c1d-ef3665f7d09d is going to be updated. [ 937.223866] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.224445] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.224445] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.224445] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.224575] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.240238] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 008501d4-938b-4336-9c1d-ef3665f7d09d in Status: IN_PROGRESS for 2s [ 937.490408] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2a486daa-61e9-4bbe-aae4-7599fe37c7b6 [ 937.490726] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.490870] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.490935] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.491177] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.491271] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.491368] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2a486daa-61e9-4bbe-aae4-7599fe37c7b6 already deleted. [ 937.491450] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a486daa-61e9-4bbe-aae4-7599fe37c7b6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.590725] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.862422] env[69506]: INFO networking_nsxv3.common.synchronization [req-c5d2a6fc-fb45-4b09-add2-16376c3934da req-2bde68b7-665a-4dfb-9d05-c86e7fa7605f service nova] Enqueued Resource ID: c0818539-e942-4d2b-a340-3442e08309ce with Priority: HIGHEST for action security_group_rules [ 937.862422] env[69506]: INFO networking_nsxv3.common.synchronization [req-c5d2a6fc-fb45-4b09-add2-16376c3934da req-2bde68b7-665a-4dfb-9d05-c86e7fa7605f service nova] Enqueued Resource ID: c0818539-e942-4d2b-a340-3442e08309ce with Priority: HIGHEST for action security_group_members [ 937.862422] env[69506]: INFO networking_nsxv3.common.synchronization [req-c5d2a6fc-fb45-4b09-add2-16376c3934da req-2bde68b7-665a-4dfb-9d05-c86e7fa7605f service nova] Enqueued Resource ID: 27fae32d-5f1c-4278-85b5-4303d9a5eb19 with Priority: HIGHEST for action port [ 937.862422] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0818539-e942-4d2b-a340-3442e08309ce with Priority: HIGHEST for action security_group_rules [ 937.862422] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0818539-e942-4d2b-a340-3442e08309ce with Priority: HIGHEST for action security_group_members [ 937.862422] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27fae32d-5f1c-4278-85b5-4303d9a5eb19 with Priority: HIGHEST for action port [ 937.863216] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0818539-e942-4d2b-a340-3442e08309ce taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.864803] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0818539-e942-4d2b-a340-3442e08309ce" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.864803] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0818539-e942-4d2b-a340-3442e08309ce" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.864803] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0818539-e942-4d2b-a340-3442e08309ce" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.864803] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0818539-e942-4d2b-a340-3442e08309ce',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.867459] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0818539-e942-4d2b-a340-3442e08309ce taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.867459] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0818539-e942-4d2b-a340-3442e08309ce" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.867459] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0818539-e942-4d2b-a340-3442e08309ce" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.867459] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0818539-e942-4d2b-a340-3442e08309ce" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.867459] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.867459] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.867459] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.870543] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.870543] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.870543] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0818539-e942-4d2b-a340-3442e08309ce',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.870968] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-27fae32d-5f1c-4278-85b5-4303d9a5eb19 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.870968] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27fae32d-5f1c-4278-85b5-4303d9a5eb19" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.870968] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27fae32d-5f1c-4278-85b5-4303d9a5eb19" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.870968] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27fae32d-5f1c-4278-85b5-4303d9a5eb19" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.871176] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27fae32d-5f1c-4278-85b5-4303d9a5eb19',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.095017] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.176721] env[69506]: INFO networking_nsxv3.common.synchronization [req-2e64b651-150a-499c-9106-c833390eaf4c req-84196d7a-f37b-4d09-b0fd-ba5f78d84e92 tempest-ServersV294TestFqdnHostnames-1239405206 tempest-ServersV294TestFqdnHostnames-1239405206-project-member] Enqueued Resource ID: cb920054-1c0f-4a74-aad1-8ca7ce036993 with Priority: HIGHEST for action security_group_members [ 938.177246] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb920054-1c0f-4a74-aad1-8ca7ce036993 with Priority: HIGHEST for action security_group_members [ 938.177574] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb920054-1c0f-4a74-aad1-8ca7ce036993 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.177703] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb920054-1c0f-4a74-aad1-8ca7ce036993" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.177781] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb920054-1c0f-4a74-aad1-8ca7ce036993" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.178498] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb920054-1c0f-4a74-aad1-8ca7ce036993" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.178694] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.178812] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.178882] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.179099] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.179189] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.179291] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb920054-1c0f-4a74-aad1-8ca7ce036993',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.367128] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0818539-e942-4d2b-a340-3442e08309ce taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.367630] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0818539-e942-4d2b-a340-3442e08309ce" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.373807] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0818539-e942-4d2b-a340-3442e08309ce',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.374788] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 27fae32d-5f1c-4278-85b5-4303d9a5eb19 with status ACTIVE [ 938.375162] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.376394] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.376394] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.376394] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.376394] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.376394] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.376394] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.376394] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.376974] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.376974] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.376974] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.376974] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.376974] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.377132] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.377132] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.377246] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 27fae32d-5f1c-4278-85b5-4303d9a5eb19 is going to be updated. [ 938.390043] env[69506]: INFO networking_nsxv3.common.synchronization [req-03960d65-1900-46dc-8642-71d7d62654ab req-4d72407b-927c-4dfa-af27-6f38bacfe7db tempest-MigrationsAdminTest-625008670 tempest-MigrationsAdminTest-625008670-project-member] Enqueued Resource ID: 0745f36a-3469-4c49-9c0f-8111fe1bd802 with Priority: HIGHEST for action security_group_members [ 938.390554] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0745f36a-3469-4c49-9c0f-8111fe1bd802 with Priority: HIGHEST for action security_group_members [ 938.391658] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0745f36a-3469-4c49-9c0f-8111fe1bd802 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.392105] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.392105] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.392314] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.392314] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.392424] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.392480] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.392626] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.392707] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.392804] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0745f36a-3469-4c49-9c0f-8111fe1bd802',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.399038] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.399162] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.399231] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.399413] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.399572] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.399739] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27fae32d-5f1c-4278-85b5-4303d9a5eb19" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.591030] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-732 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.591298] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-732" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.591359] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-732" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.591741] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-732" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.592054] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.592211] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.592329] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.592568] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.592695] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.592928] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 938.594238] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 938.594238] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 938.594238] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 938.594238] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 938.594238] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 938.594238] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 938.600585] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.600719] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.600830] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.601069] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.601248] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.601334] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 is going to be updated. [ 938.615739] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 938.616143] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 938.616248] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 938.616376] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-732" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.616701] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-bb0c7c9b-7a01-4abb-8427-b1106df368f3 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.617323] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-bb0c7c9b-7a01-4abb-8427-b1106df368f3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.617323] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-bb0c7c9b-7a01-4abb-8427-b1106df368f3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.617459] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-bb0c7c9b-7a01-4abb-8427-b1106df368f3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.617599] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb0c7c9b-7a01-4abb-8427-b1106df368f3',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.648479] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.648649] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.648727] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.648956] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.649198] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.661891] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: IN_PROGRESS for 2s [ 938.681283] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.681530] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.681915] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.682210] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.682298] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.682514] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.682632] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.682698] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.682858] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.682942] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.683033] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb920054-1c0f-4a74-aad1-8ca7ce036993 already deleted. [ 938.683127] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb920054-1c0f-4a74-aad1-8ca7ce036993" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.799929] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 in Status: SUCCESS [ 938.799929] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.799929] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.799929] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.799929] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.799929] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.799929] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.799929] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.799929] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.799929] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.799929] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c0ce237-8ae5-4e9f-857a-af422cd22902',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.879868] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0818539-e942-4d2b-a340-3442e08309ce',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.895567] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.895802] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.895932] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.896319] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.917456] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.917456] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.917456] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.917456] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.917456] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.917456] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.917456] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0745f36a-3469-4c49-9c0f-8111fe1bd802 is going to be updated. [ 938.940140] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.940402] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.940402] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.940773] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.940773] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.950011] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0745f36a-3469-4c49-9c0f-8111fe1bd802 in Status: IN_PROGRESS for 2s [ 939.120344] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.120633] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.120778] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.121164] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.121332] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.121496] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port bb0c7c9b-7a01-4abb-8427-b1106df368f3 not found, creating... [ 939.121951] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.122242] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.122242] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.122383] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.122730] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.122871] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.123092] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.123280] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.123838] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.123838] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.124151] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: bb0c7c9b-7a01-4abb-8427-b1106df368f3 is going to be created. [ 939.147546] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.147787] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.147926] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.148245] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.148498] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.148713] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-bb0c7c9b-7a01-4abb-8427-b1106df368f3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.252250] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 008501d4-938b-4336-9c1d-ef3665f7d09d in Status: SUCCESS [ 939.252882] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.302992] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c0ce237-8ae5-4e9f-857a-af422cd22902 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.303185] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.303259] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.303534] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.303677] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.303782] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.303867] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.303993] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.304096] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.304187] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.304335] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c0ce237-8ae5-4e9f-857a-af422cd22902 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.304428] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.304488] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.304631] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.304769] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.304865] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.304925] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.305058] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.305158] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.305209] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.309521] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c0ce237-8ae5-4e9f-857a-af422cd22902',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.382800] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.383176] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.383176] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.383267] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.383329] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.383436] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0818539-e942-4d2b-a340-3442e08309ce is going to be created. [ 939.405673] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.405854] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.405854] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.406060] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.406222] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.415486] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0818539-e942-4d2b-a340-3442e08309ce in Status: UNINITIALIZED for 2s [ 939.811070] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c0ce237-8ae5-4e9f-857a-af422cd22902: rpc.has_security_group_logging(os_id): False [ 939.832429] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.832429] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.832429] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.832612] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.832702] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.832947] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.833062] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.833125] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.833277] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.833355] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.833672] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.833672] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.833780] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.833840] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.834087] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.834358] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.834467] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.834549] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.834746] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.834779] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.835140] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 is going to be created. [ 939.850950] env[69506]: INFO networking_nsxv3.common.synchronization [req-363a8386-80bf-44a8-879b-57d92249c5ad req-c060c871-9aab-4eb2-9b15-e79053d5a5e1 tempest-ServerActionsTestOtherB-347258904 tempest-ServerActionsTestOtherB-347258904-project-member] Enqueued Resource ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 with Priority: HIGHEST for action security_group_members [ 939.851602] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 with Priority: HIGHEST for action security_group_members [ 939.852011] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.855725] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.855725] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.855725] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.855725] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.855932] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.855932] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.856010] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.856093] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.856186] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fca9cd47-c1fb-4023-8f12-fa1b22a98fd8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.892636] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.892865] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.892865] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.893133] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.893315] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.904295] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 in Status: IN_PROGRESS for 2s [ 940.073609] env[69506]: INFO networking_nsxv3.common.synchronization [req-2e64b651-150a-499c-9106-c833390eaf4c req-833024b3-a6ed-45af-9ac6-c0acddc7fa1f service nova] Enqueued Resource ID: cb920054-1c0f-4a74-aad1-8ca7ce036993 with Priority: HIGHEST for action security_group_rules [ 940.073803] env[69506]: INFO networking_nsxv3.common.synchronization [req-2e64b651-150a-499c-9106-c833390eaf4c req-833024b3-a6ed-45af-9ac6-c0acddc7fa1f service nova] Enqueued Resource ID: cb920054-1c0f-4a74-aad1-8ca7ce036993 with Priority: HIGHEST for action security_group_members [ 940.073949] env[69506]: INFO networking_nsxv3.common.synchronization [req-2e64b651-150a-499c-9106-c833390eaf4c req-833024b3-a6ed-45af-9ac6-c0acddc7fa1f service nova] Enqueued Resource ID: bb0c7c9b-7a01-4abb-8427-b1106df368f3 with Priority: HIGHEST for action port [ 940.074216] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb920054-1c0f-4a74-aad1-8ca7ce036993 with Priority: HIGHEST for action security_group_rules [ 940.074351] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb920054-1c0f-4a74-aad1-8ca7ce036993 with Priority: HIGHEST for action security_group_members [ 940.074447] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb0c7c9b-7a01-4abb-8427-b1106df368f3 with Priority: HIGHEST for action port [ 940.074987] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb920054-1c0f-4a74-aad1-8ca7ce036993 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.076988] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb920054-1c0f-4a74-aad1-8ca7ce036993" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.077096] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb920054-1c0f-4a74-aad1-8ca7ce036993" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.077413] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb920054-1c0f-4a74-aad1-8ca7ce036993" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.077506] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb920054-1c0f-4a74-aad1-8ca7ce036993',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.078374] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb920054-1c0f-4a74-aad1-8ca7ce036993 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.078488] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb920054-1c0f-4a74-aad1-8ca7ce036993" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.078559] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb920054-1c0f-4a74-aad1-8ca7ce036993" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.078725] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb920054-1c0f-4a74-aad1-8ca7ce036993" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.078871] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.078964] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.079035] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.079173] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.079255] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.079346] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb920054-1c0f-4a74-aad1-8ca7ce036993',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.084139] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb0c7c9b-7a01-4abb-8427-b1106df368f3 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.084263] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb0c7c9b-7a01-4abb-8427-b1106df368f3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.084333] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb0c7c9b-7a01-4abb-8427-b1106df368f3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.084492] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb0c7c9b-7a01-4abb-8427-b1106df368f3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.084572] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb0c7c9b-7a01-4abb-8427-b1106df368f3',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.359999] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.359999] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.359999] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.359999] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.381418] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.381735] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.381882] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.381956] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.382202] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.382293] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.382390] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 is going to be updated. [ 940.409105] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.409416] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.409416] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.409636] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.409783] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.419172] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 in Status: IN_PROGRESS for 2s [ 940.589140] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb920054-1c0f-4a74-aad1-8ca7ce036993',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.589140] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb920054-1c0f-4a74-aad1-8ca7ce036993 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.589140] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb920054-1c0f-4a74-aad1-8ca7ce036993" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.589140] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bb0c7c9b-7a01-4abb-8427-b1106df368f3 with status ACTIVE [ 940.589140] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.589140] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.589140] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.589140] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.589140] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.589140] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.589140] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.589140] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.589140] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.589140] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.589640] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.589640] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.589640] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.589919] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.590024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.590132] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bb0c7c9b-7a01-4abb-8427-b1106df368f3 is going to be updated. [ 940.611510] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.612080] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.612080] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.612080] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.612080] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.612316] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb0c7c9b-7a01-4abb-8427-b1106df368f3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.675328] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: SUCCESS [ 940.675563] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.695373] env[69506]: INFO networking_nsxv3.common.synchronization [req-55ab9c10-df64-4282-8ce3-e2c55d35cc9a req-585150f0-100c-4400-a21e-8b43fe25d6c2 tempest-ServersTestJSON-1801092994 tempest-ServersTestJSON-1801092994-project-member] Enqueued Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 940.695896] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 940.696210] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.696331] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.696400] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.696655] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.697303] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.697486] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.697656] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.697993] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.698612] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.698737] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.959398] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0745f36a-3469-4c49-9c0f-8111fe1bd802 in Status: SUCCESS [ 940.959741] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0745f36a-3469-4c49-9c0f-8111fe1bd802 deletion is rescheduled due to dependency. [ 940.959845] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0745f36a-3469-4c49-9c0f-8111fe1bd802" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.088483] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-54 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.088687] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-54" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.088816] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-54" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.089202] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-54" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.089482] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.089674] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.089804] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.090245] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.090430] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.090696] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 941.090822] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 941.090936] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 941.091059] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 941.091177] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 941.091286] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 941.091415] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 941.093931] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb920054-1c0f-4a74-aad1-8ca7ce036993',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.111124] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 941.111305] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 941.111452] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 941.111641] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-54" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.112128] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-aa3a60f4-ce3c-45eb-bd7f-ff23ed4cbd8e taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.112322] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-aa3a60f4-ce3c-45eb-bd7f-ff23ed4cbd8e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.112450] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-aa3a60f4-ce3c-45eb-bd7f-ff23ed4cbd8e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.112776] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-aa3a60f4-ce3c-45eb-bd7f-ff23ed4cbd8e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.112922] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa3a60f4-ce3c-45eb-bd7f-ff23ed4cbd8e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.201792] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.201977] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.202069] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.202302] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.202389] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.202587] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.202679] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.202739] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.202881] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.202951] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.203041] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc already deleted. [ 941.203116] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.426159] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0818539-e942-4d2b-a340-3442e08309ce in Status: SUCCESS [ 941.426531] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0818539-e942-4d2b-a340-3442e08309ce" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.426600] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0818539-e942-4d2b-a340-3442e08309ce" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.426787] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0818539-e942-4d2b-a340-3442e08309ce" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.426976] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.427097] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.427159] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.427312] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.427389] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.427473] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0818539-e942-4d2b-a340-3442e08309ce" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.427571] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0818539-e942-4d2b-a340-3442e08309ce',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.598878] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.598878] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.598878] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.598878] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.598878] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.598878] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb920054-1c0f-4a74-aad1-8ca7ce036993 is going to be created. [ 941.616563] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.619454] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.619454] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.619454] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.619454] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.619454] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port aa3a60f4-ce3c-45eb-bd7f-ff23ed4cbd8e not found, creating... [ 941.619454] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.619454] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.619454] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.619454] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.619454] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.619944] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.619944] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.619944] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.621038] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.621038] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.621038] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: aa3a60f4-ce3c-45eb-bd7f-ff23ed4cbd8e is going to be created. [ 941.623382] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.623518] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.623595] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.623758] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.623907] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.635017] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb920054-1c0f-4a74-aad1-8ca7ce036993 in Status: UNINITIALIZED for 2s [ 941.651269] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.651488] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.651615] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.651931] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.652191] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.652417] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-aa3a60f4-ce3c-45eb-bd7f-ff23ed4cbd8e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.919026] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 in Status: SUCCESS [ 941.919026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.935401] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0818539-e942-4d2b-a340-3442e08309ce taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.937027] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0818539-e942-4d2b-a340-3442e08309ce" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.937027] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0818539-e942-4d2b-a340-3442e08309ce" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.937027] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0818539-e942-4d2b-a340-3442e08309ce" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.937027] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.937027] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.937027] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.937027] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.937027] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.937027] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0818539-e942-4d2b-a340-3442e08309ce" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.937027] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0818539-e942-4d2b-a340-3442e08309ce taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.937027] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0818539-e942-4d2b-a340-3442e08309ce" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.937542] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0818539-e942-4d2b-a340-3442e08309ce" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.937542] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0818539-e942-4d2b-a340-3442e08309ce" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.937661] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.937759] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.937819] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.937979] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.938546] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.938546] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0818539-e942-4d2b-a340-3442e08309ce" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.938546] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0818539-e942-4d2b-a340-3442e08309ce',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.437765] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 in Status: SUCCESS [ 942.438292] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 deletion is rescheduled due to dependency. [ 942.438292] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.442829] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0818539-e942-4d2b-a340-3442e08309ce: rpc.has_security_group_logging(os_id): False [ 942.462550] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.462775] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.462915] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.463239] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.463359] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.463766] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.463936] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.464275] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.464588] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.464736] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.465027] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.465257] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.465402] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.465751] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.467599] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.467599] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.467599] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.467599] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.467599] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.467599] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.467599] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0818539-e942-4d2b-a340-3442e08309ce is going to be created. [ 942.530027] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.530027] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.530027] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.530027] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.530027] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.544025] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0818539-e942-4d2b-a340-3442e08309ce in Status: IN_PROGRESS for 2s [ 942.561633] env[69506]: INFO networking_nsxv3.common.synchronization [req-55ab9c10-df64-4282-8ce3-e2c55d35cc9a req-2cffce60-5810-4675-ba76-9be525f4fcc8 service nova] Enqueued Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_rules [ 942.561806] env[69506]: INFO networking_nsxv3.common.synchronization [req-55ab9c10-df64-4282-8ce3-e2c55d35cc9a req-2cffce60-5810-4675-ba76-9be525f4fcc8 service nova] Enqueued Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 942.561946] env[69506]: INFO networking_nsxv3.common.synchronization [req-55ab9c10-df64-4282-8ce3-e2c55d35cc9a req-2cffce60-5810-4675-ba76-9be525f4fcc8 service nova] Enqueued Resource ID: aa3a60f4-ce3c-45eb-bd7f-ff23ed4cbd8e with Priority: HIGHEST for action port [ 942.562192] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_rules [ 942.562318] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 942.562410] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa3a60f4-ce3c-45eb-bd7f-ff23ed4cbd8e with Priority: HIGHEST for action port [ 942.562975] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.563110] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.563391] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.563441] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.563499] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.564362] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.564469] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.564533] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.564703] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.564851] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.565027] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.565027] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.565141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.565229] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.565314] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.569031] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa3a60f4-ce3c-45eb-bd7f-ff23ed4cbd8e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.569163] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa3a60f4-ce3c-45eb-bd7f-ff23ed4cbd8e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.569287] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa3a60f4-ce3c-45eb-bd7f-ff23ed4cbd8e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.569336] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa3a60f4-ce3c-45eb-bd7f-ff23ed4cbd8e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.569602] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa3a60f4-ce3c-45eb-bd7f-ff23ed4cbd8e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.074519] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.077156] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.077156] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.077156] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aa3a60f4-ce3c-45eb-bd7f-ff23ed4cbd8e with status ACTIVE [ 943.077156] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.077156] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.077156] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.077156] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.077156] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.077156] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.077156] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.077156] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.077156] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.077156] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.077732] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.077732] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.077732] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.077732] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.077732] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.077732] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aa3a60f4-ce3c-45eb-bd7f-ff23ed4cbd8e is going to be updated. [ 943.101130] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.101438] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.101438] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.101550] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.101682] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.101841] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa3a60f4-ce3c-45eb-bd7f-ff23ed4cbd8e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.579561] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.644836] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb920054-1c0f-4a74-aad1-8ca7ce036993 in Status: SUCCESS [ 943.645057] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb920054-1c0f-4a74-aad1-8ca7ce036993" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.645214] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb920054-1c0f-4a74-aad1-8ca7ce036993" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.645433] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb920054-1c0f-4a74-aad1-8ca7ce036993" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.645647] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.645787] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.645837] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.646885] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.646885] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.646885] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb920054-1c0f-4a74-aad1-8ca7ce036993" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.646885] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb920054-1c0f-4a74-aad1-8ca7ce036993',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.084418] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.084418] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.084418] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.084418] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.084418] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.084418] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc is going to be created. [ 944.110061] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.110061] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.110061] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.110305] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.110305] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.119646] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: UNINITIALIZED for 2s [ 944.148371] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb920054-1c0f-4a74-aad1-8ca7ce036993',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.455867] env[69506]: INFO networking_nsxv3.common.synchronization [req-c6227e22-2348-4ba0-a685-a1c5ecc0377d req-e29e0fda-7f91-4d74-9233-2489c914402a tempest-ServersTestBootFromVolume-165190847 tempest-ServersTestBootFromVolume-165190847-project-member] Enqueued Resource ID: 9f130eeb-c453-4570-b0fe-743f47890102 with Priority: HIGHEST for action security_group_members [ 944.455867] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f130eeb-c453-4570-b0fe-743f47890102 with Priority: HIGHEST for action security_group_members [ 944.456722] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f130eeb-c453-4570-b0fe-743f47890102 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.457145] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f130eeb-c453-4570-b0fe-743f47890102" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.457428] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f130eeb-c453-4570-b0fe-743f47890102" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.459030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f130eeb-c453-4570-b0fe-743f47890102" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.459030] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.459030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.459030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.459030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.460259] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.461531] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f130eeb-c453-4570-b0fe-743f47890102',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.555381] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0818539-e942-4d2b-a340-3442e08309ce in Status: SUCCESS [ 944.556302] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0818539-e942-4d2b-a340-3442e08309ce" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.651130] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb920054-1c0f-4a74-aad1-8ca7ce036993: rpc.has_security_group_logging(os_id): False [ 944.668935] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.669171] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.669249] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.669706] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.669914] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.670294] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.671098] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.671248] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.671476] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.671592] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.671714] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb920054-1c0f-4a74-aad1-8ca7ce036993 is going to be created. [ 944.731965] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.732208] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.732208] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.732466] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.732611] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.743303] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb920054-1c0f-4a74-aad1-8ca7ce036993 in Status: IN_PROGRESS for 2s [ 944.964931] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.965128] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.965573] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.965573] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.985509] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.985767] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.985884] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.985949] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.986165] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.986245] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.986333] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f130eeb-c453-4570-b0fe-743f47890102 is going to be updated. [ 945.012137] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.012137] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.012137] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.012137] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.012137] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.020778] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f130eeb-c453-4570-b0fe-743f47890102 in Status: IN_PROGRESS for 2s [ 945.205794] env[69506]: INFO networking_nsxv3.common.synchronization [req-ae19a3cd-c878-4ea7-8975-398738fffb8f req-837381e3-591f-42e0-bd67-0e51c7e41f01 tempest-ImagesOneServerNegativeTestJSON-1660335094 tempest-ImagesOneServerNegativeTestJSON-1660335094-project-member] Enqueued Resource ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 with Priority: HIGHEST for action security_group_members [ 945.206631] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 with Priority: HIGHEST for action security_group_members [ 945.206931] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bc29505-f5b4-4554-85b9-541273bd8da3 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.207291] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.207428] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.207762] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.207989] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.208440] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.208440] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.208440] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.208583] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.208682] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bc29505-f5b4-4554-85b9-541273bd8da3',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.715974] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.716323] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.716323] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.716481] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.716574] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.716844] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.716952] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.717032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.717283] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.717381] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.717505] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 already deleted. [ 945.717651] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.851199] env[69506]: INFO networking_nsxv3.common.synchronization [req-594ff2d0-ff99-407d-adfb-a81848aee66d req-92d86d9e-0241-45d0-bc41-29cd49676fe0 tempest-ServersAdminTestJSON-446545879 tempest-ServersAdminTestJSON-446545879-project-member] Enqueued Resource ID: 706a5462-e893-428d-beb2-737cbec00439 with Priority: HIGHEST for action security_group_members [ 945.851817] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 706a5462-e893-428d-beb2-737cbec00439 with Priority: HIGHEST for action security_group_members [ 945.852527] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-706a5462-e893-428d-beb2-737cbec00439 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.852964] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.853091] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.853932] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.853932] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.853932] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.853932] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.853932] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.853932] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.854261] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.101895] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-370 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.102174] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-370" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.102388] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-370" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.102652] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-370" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.102943] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.103124] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.103260] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.103520] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.104152] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.104152] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 946.104152] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 946.104152] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 946.104302] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 946.104379] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 946.104484] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 946.104641] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 946.123031] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 946.123316] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 946.123551] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 946.123896] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-370" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.124328] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-65f2fe99-b38c-4563-9d0d-624a72dd4792 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.124562] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-65f2fe99-b38c-4563-9d0d-624a72dd4792" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.124671] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-65f2fe99-b38c-4563-9d0d-624a72dd4792" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.125074] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-65f2fe99-b38c-4563-9d0d-624a72dd4792" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.125264] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65f2fe99-b38c-4563-9d0d-624a72dd4792',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.128342] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: UNINITIALIZED for 4s [ 946.357074] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.357303] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.357402] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.357801] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.357926] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.359034] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.359034] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.359034] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.359034] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.359034] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.359034] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 706a5462-e893-428d-beb2-737cbec00439 is going to be updated. [ 946.405087] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.405304] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.405545] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.405653] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.405843] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.418358] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 706a5462-e893-428d-beb2-737cbec00439 in Status: IN_PROGRESS for 2s [ 946.627825] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.628097] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.628247] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.628615] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.628789] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.628950] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 65f2fe99-b38c-4563-9d0d-624a72dd4792 not found, creating... [ 946.629233] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.629399] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.629529] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.629775] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.629929] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.630340] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.630516] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.630657] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.630887] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.631046] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.631197] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 65f2fe99-b38c-4563-9d0d-624a72dd4792 is going to be created. [ 946.654729] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.654977] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.655155] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.655481] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.655746] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.655975] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-65f2fe99-b38c-4563-9d0d-624a72dd4792" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.759813] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb920054-1c0f-4a74-aad1-8ca7ce036993 in Status: SUCCESS [ 946.760173] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb920054-1c0f-4a74-aad1-8ca7ce036993" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.031137] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f130eeb-c453-4570-b0fe-743f47890102 in Status: SUCCESS [ 947.031472] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f130eeb-c453-4570-b0fe-743f47890102 deletion is rescheduled due to dependency. [ 947.031472] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f130eeb-c453-4570-b0fe-743f47890102" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.473851] env[69506]: INFO networking_nsxv3.common.synchronization [req-ae19a3cd-c878-4ea7-8975-398738fffb8f req-e62d8354-d918-449f-8e27-1366261696fd service nova] Enqueued Resource ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 with Priority: HIGHEST for action security_group_rules [ 947.474069] env[69506]: INFO networking_nsxv3.common.synchronization [req-ae19a3cd-c878-4ea7-8975-398738fffb8f req-e62d8354-d918-449f-8e27-1366261696fd service nova] Enqueued Resource ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 with Priority: HIGHEST for action security_group_members [ 947.474286] env[69506]: INFO networking_nsxv3.common.synchronization [req-ae19a3cd-c878-4ea7-8975-398738fffb8f req-e62d8354-d918-449f-8e27-1366261696fd service nova] Enqueued Resource ID: 65f2fe99-b38c-4563-9d0d-624a72dd4792 with Priority: HIGHEST for action port [ 947.475929] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 with Priority: HIGHEST for action security_group_rules [ 947.476097] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 with Priority: HIGHEST for action security_group_members [ 947.476202] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65f2fe99-b38c-4563-9d0d-624a72dd4792 with Priority: HIGHEST for action port [ 947.476857] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0bc29505-f5b4-4554-85b9-541273bd8da3 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.477069] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.477181] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.477447] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.477536] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0bc29505-f5b4-4554-85b9-541273bd8da3',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.481253] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bc29505-f5b4-4554-85b9-541273bd8da3 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.481378] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.481453] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.481655] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.481933] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.482056] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.482127] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.482292] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.482377] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.482477] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bc29505-f5b4-4554-85b9-541273bd8da3',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.483877] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-65f2fe99-b38c-4563-9d0d-624a72dd4792 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.483969] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65f2fe99-b38c-4563-9d0d-624a72dd4792" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.484053] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65f2fe99-b38c-4563-9d0d-624a72dd4792" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.484227] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65f2fe99-b38c-4563-9d0d-624a72dd4792" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.484307] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65f2fe99-b38c-4563-9d0d-624a72dd4792',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.984421] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0bc29505-f5b4-4554-85b9-541273bd8da3',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.985827] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 65f2fe99-b38c-4563-9d0d-624a72dd4792 with status ACTIVE [ 947.986068] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.986195] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.986265] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.986494] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.986598] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.986797] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.986896] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.986962] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.987312] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.987312] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.987508] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.987508] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.987591] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.987673] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.987721] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.987804] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 65f2fe99-b38c-4563-9d0d-624a72dd4792 is going to be updated. [ 947.988937] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bc29505-f5b4-4554-85b9-541273bd8da3 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.989083] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.011106] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.011106] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.011106] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.011106] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.011106] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.011106] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65f2fe99-b38c-4563-9d0d-624a72dd4792" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.146212] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: SUCCESS [ 948.146499] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.146671] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.146917] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.147127] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.147245] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.147310] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.147664] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.147664] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.147664] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.147801] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.428641] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 706a5462-e893-428d-beb2-737cbec00439 in Status: SUCCESS [ 948.428833] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 706a5462-e893-428d-beb2-737cbec00439 deletion is rescheduled due to dependency. [ 948.428944] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.486819] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0bc29505-f5b4-4554-85b9-541273bd8da3',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.652902] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.652902] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.652902] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.652902] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.652902] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.652902] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.653346] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.653346] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.653346] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.653542] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.653728] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.653876] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.654314] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.654314] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.654428] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.654517] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.654627] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.654823] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.654890] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.654977] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.655122] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.989690] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.989988] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.989988] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.990165] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.990607] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.990607] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 is going to be created. [ 949.015252] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.015460] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.015591] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.015861] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.016212] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.025512] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 in Status: UNINITIALIZED for 2s [ 949.157319] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc: rpc.has_security_group_logging(os_id): False [ 949.177299] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.177451] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.177515] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.177724] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.177810] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.178028] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.178126] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.178187] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.178373] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.178431] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.178600] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.178684] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.178747] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.179983] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.180094] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.180292] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.180387] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.180454] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.180591] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.180664] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.180751] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc is going to be created. [ 949.251416] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.251651] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.251651] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.251907] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.252061] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.264513] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: IN_PROGRESS for 2s [ 950.111958] env[69506]: INFO networking_nsxv3.common.synchronization [req-f2365e95-f3e6-43f0-9181-cd7e2565d04e req-214b26ee-03ca-4bbf-8d45-6ff866535415 tempest-ImagesTestJSON-821230832 tempest-ImagesTestJSON-821230832-project-member] Enqueued Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_members [ 950.117164] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_members [ 950.117164] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0db323-2ed4-4f6a-a30a-405b16133cb2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.117164] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.117164] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.117164] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.117164] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.117164] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.117164] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.117164] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.117164] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.117164] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.212362] env[69506]: INFO networking_nsxv3.common.synchronization [req-3332f8ec-3988-44ba-9cd4-f5f3dbd2c63e req-cc4b76d6-973d-4402-8cb8-aef6c50b478f tempest-InstanceActionsV221TestJSON-1814289415 tempest-InstanceActionsV221TestJSON-1814289415-project-member] Enqueued Resource ID: c0818539-e942-4d2b-a340-3442e08309ce with Priority: HIGHEST for action security_group_members [ 950.213561] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0818539-e942-4d2b-a340-3442e08309ce with Priority: HIGHEST for action security_group_members [ 950.214021] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0818539-e942-4d2b-a340-3442e08309ce taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.214221] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0818539-e942-4d2b-a340-3442e08309ce" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.214307] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0818539-e942-4d2b-a340-3442e08309ce" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.214548] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0818539-e942-4d2b-a340-3442e08309ce" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.214711] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.214819] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.214894] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.215081] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.215168] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.215260] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0818539-e942-4d2b-a340-3442e08309ce',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.618122] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.618304] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.618354] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.618588] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.618678] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.619506] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.619506] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.619506] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.619506] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.619506] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.619506] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 is going to be updated. [ 950.648461] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.648645] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.648714] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.649216] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.649396] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.663768] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: IN_PROGRESS for 2s [ 950.719145] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.719305] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.719397] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.719613] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.719720] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.720297] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.720297] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.720297] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.720297] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.720297] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.720557] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0818539-e942-4d2b-a340-3442e08309ce is going to be updated. [ 950.757264] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.757478] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.757544] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.758171] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.758171] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.768934] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0818539-e942-4d2b-a340-3442e08309ce in Status: IN_PROGRESS for 2s [ 951.037080] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 in Status: SUCCESS [ 951.037080] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.037080] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.037080] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.037080] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.037080] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.037080] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.037080] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.037080] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.037080] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.037080] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0bc29505-f5b4-4554-85b9-541273bd8da3',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.278437] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: SUCCESS [ 951.278769] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.540289] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bc29505-f5b4-4554-85b9-541273bd8da3 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.540447] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.540521] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.540750] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.540917] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.541031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.541096] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.541247] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.541334] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.541455] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.541566] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bc29505-f5b4-4554-85b9-541273bd8da3 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.541661] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.541730] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.541906] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.541995] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.542099] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.542158] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.542289] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.542363] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.542450] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.542531] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0bc29505-f5b4-4554-85b9-541273bd8da3',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.045356] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0bc29505-f5b4-4554-85b9-541273bd8da3: rpc.has_security_group_logging(os_id): False [ 952.066302] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.066452] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.066518] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.066746] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.066844] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.067169] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.067273] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.067328] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.067566] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.067646] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.067855] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.067953] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.068022] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.068185] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.068266] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.068515] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.068622] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.068677] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.068822] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.068893] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.068991] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 is going to be created. [ 952.137502] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.137792] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.137944] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.138168] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.139360] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.151444] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 in Status: IN_PROGRESS for 2s [ 952.675109] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: SUCCESS [ 952.675109] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 deletion is rescheduled due to dependency. [ 952.675109] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.780660] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0818539-e942-4d2b-a340-3442e08309ce in Status: SUCCESS [ 952.780914] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0818539-e942-4d2b-a340-3442e08309ce deletion is rescheduled due to dependency. [ 952.781128] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0818539-e942-4d2b-a340-3442e08309ce" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.882524] env[69506]: INFO networking_nsxv3.common.synchronization [req-0e6bf45a-e4cc-4c86-a50a-086cb66235d0 req-277fe953-9594-4ef7-bc3a-b90ada10c835 tempest-ServerRescueTestJSONUnderV235-927744761 tempest-ServerRescueTestJSONUnderV235-927744761-project-member] Enqueued Resource ID: 0309a1e7-9ef7-401a-8b73-8ed732d1e19c with Priority: HIGHEST for action security_group_members [ 952.884396] env[69506]: INFO networking_nsxv3.common.synchronization [req-0e6bf45a-e4cc-4c86-a50a-086cb66235d0 req-277fe953-9594-4ef7-bc3a-b90ada10c835 tempest-ServerRescueTestJSONUnderV235-927744761 tempest-ServerRescueTestJSONUnderV235-927744761-project-member] Enqueued Resource ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 with Priority: HIGHEST for action security_group_members [ 952.884396] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0309a1e7-9ef7-401a-8b73-8ed732d1e19c with Priority: HIGHEST for action security_group_members [ 952.884396] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 with Priority: HIGHEST for action security_group_members [ 952.884396] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0309a1e7-9ef7-401a-8b73-8ed732d1e19c taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.884396] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0309a1e7-9ef7-401a-8b73-8ed732d1e19c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.884396] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0309a1e7-9ef7-401a-8b73-8ed732d1e19c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.885917] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0309a1e7-9ef7-401a-8b73-8ed732d1e19c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.885917] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.885917] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.885917] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.885917] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.885917] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.885917] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0309a1e7-9ef7-401a-8b73-8ed732d1e19c',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.886307] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c0ce237-8ae5-4e9f-857a-af422cd22902 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.886421] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.886486] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.886705] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.886848] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.886944] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.887017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.887166] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.887249] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.887339] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c0ce237-8ae5-4e9f-857a-af422cd22902',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.939780] env[69506]: INFO networking_nsxv3.common.synchronization [req-0e6bf45a-e4cc-4c86-a50a-086cb66235d0 req-277fe953-9594-4ef7-bc3a-b90ada10c835 tempest-ServerRescueTestJSONUnderV235-927744761 tempest-ServerRescueTestJSONUnderV235-927744761-project-member] Enqueued Resource ID: 0309a1e7-9ef7-401a-8b73-8ed732d1e19c with Priority: HIGHEST for action security_group_rules [ 952.940628] env[69506]: INFO networking_nsxv3.common.synchronization [req-0e6bf45a-e4cc-4c86-a50a-086cb66235d0 req-277fe953-9594-4ef7-bc3a-b90ada10c835 tempest-ServerRescueTestJSONUnderV235-927744761 tempest-ServerRescueTestJSONUnderV235-927744761-project-member] Enqueued Resource ID: 0309a1e7-9ef7-401a-8b73-8ed732d1e19c with Priority: HIGHEST for action security_group_members [ 952.940946] env[69506]: INFO networking_nsxv3.common.synchronization [req-0e6bf45a-e4cc-4c86-a50a-086cb66235d0 req-277fe953-9594-4ef7-bc3a-b90ada10c835 tempest-ServerRescueTestJSONUnderV235-927744761 tempest-ServerRescueTestJSONUnderV235-927744761-project-member] Enqueued Resource ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 with Priority: HIGHEST for action security_group_rules [ 952.941230] env[69506]: INFO networking_nsxv3.common.synchronization [req-0e6bf45a-e4cc-4c86-a50a-086cb66235d0 req-277fe953-9594-4ef7-bc3a-b90ada10c835 tempest-ServerRescueTestJSONUnderV235-927744761 tempest-ServerRescueTestJSONUnderV235-927744761-project-member] Enqueued Resource ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 with Priority: HIGHEST for action security_group_members [ 952.941815] env[69506]: INFO networking_nsxv3.common.synchronization [req-0e6bf45a-e4cc-4c86-a50a-086cb66235d0 req-277fe953-9594-4ef7-bc3a-b90ada10c835 tempest-ServerRescueTestJSONUnderV235-927744761 tempest-ServerRescueTestJSONUnderV235-927744761-project-member] Enqueued Resource ID: b4d0ef17-87ed-494d-94b1-bf5678c7dbd4 with Priority: HIGHEST for action port [ 952.942878] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0309a1e7-9ef7-401a-8b73-8ed732d1e19c with Priority: HIGHEST for action security_group_rules [ 952.943352] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 with Priority: HIGHEST for action security_group_rules [ 952.943786] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d0ef17-87ed-494d-94b1-bf5678c7dbd4 with Priority: HIGHEST for action port [ 952.943978] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0309a1e7-9ef7-401a-8b73-8ed732d1e19c with Priority: HIGHEST for action security_group_members [ 952.944197] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 with Priority: HIGHEST for action security_group_members [ 952.945506] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0309a1e7-9ef7-401a-8b73-8ed732d1e19c taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.946256] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0309a1e7-9ef7-401a-8b73-8ed732d1e19c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.946389] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0309a1e7-9ef7-401a-8b73-8ed732d1e19c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.946675] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0309a1e7-9ef7-401a-8b73-8ed732d1e19c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.946764] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0309a1e7-9ef7-401a-8b73-8ed732d1e19c',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.948269] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c0ce237-8ae5-4e9f-857a-af422cd22902 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.948396] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.948466] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.948806] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.948894] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c0ce237-8ae5-4e9f-857a-af422cd22902',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.950224] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4d0ef17-87ed-494d-94b1-bf5678c7dbd4 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.950437] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4d0ef17-87ed-494d-94b1-bf5678c7dbd4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.950529] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4d0ef17-87ed-494d-94b1-bf5678c7dbd4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.950709] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4d0ef17-87ed-494d-94b1-bf5678c7dbd4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.950791] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4d0ef17-87ed-494d-94b1-bf5678c7dbd4',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.951940] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0309a1e7-9ef7-401a-8b73-8ed732d1e19c taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.952060] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0309a1e7-9ef7-401a-8b73-8ed732d1e19c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.952274] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c0ce237-8ae5-4e9f-857a-af422cd22902 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.952361] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.389188] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0309a1e7-9ef7-401a-8b73-8ed732d1e19c',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.391246] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c0ce237-8ae5-4e9f-857a-af422cd22902',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.451554] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c0ce237-8ae5-4e9f-857a-af422cd22902 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.452436] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.452954] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b4d0ef17-87ed-494d-94b1-bf5678c7dbd4 with status ACTIVE [ 953.452954] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.453108] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.453108] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.453302] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.453390] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.453568] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.453673] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.453736] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.453933] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.454042] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.454263] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.454314] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.454375] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.454516] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.454591] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.454675] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b4d0ef17-87ed-494d-94b1-bf5678c7dbd4 is going to be updated. [ 953.456707] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0309a1e7-9ef7-401a-8b73-8ed732d1e19c taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.456707] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0309a1e7-9ef7-401a-8b73-8ed732d1e19c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.463829] env[69506]: INFO networking_nsxv3.common.synchronization [req-0148d27c-105c-439a-b3d4-0af4d73c42e3 req-546166e8-6983-456b-90ab-9d0ada2880fa tempest-ListImageFiltersTestJSON-525149621 tempest-ListImageFiltersTestJSON-525149621-project-member] Enqueued Resource ID: 458c7186-d79f-4548-a2a0-95db0abbb880 with Priority: HIGHEST for action security_group_members [ 953.464392] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 458c7186-d79f-4548-a2a0-95db0abbb880 with Priority: HIGHEST for action security_group_members [ 953.464954] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-458c7186-d79f-4548-a2a0-95db0abbb880 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.464954] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.464954] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.465143] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.466079] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.466233] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.466233] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.466368] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.466469] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.466551] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('458c7186-d79f-4548-a2a0-95db0abbb880',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.475394] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.475522] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.475820] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.475820] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.475943] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.477542] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4d0ef17-87ed-494d-94b1-bf5678c7dbd4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.810487] env[69506]: INFO networking_nsxv3.common.synchronization [req-8c0e67ad-8d99-4972-8e3e-55d7fbcdf629 req-780199cc-f34f-477c-971e-6d7cf3e01506 tempest-ServerRescueTestJSONUnderV235-927744761 tempest-ServerRescueTestJSONUnderV235-927744761-project-member] Enqueued Resource ID: 0309a1e7-9ef7-401a-8b73-8ed732d1e19c with Priority: HIGHEST for action security_group_members [ 953.811045] env[69506]: INFO networking_nsxv3.common.synchronization [req-8c0e67ad-8d99-4972-8e3e-55d7fbcdf629 req-780199cc-f34f-477c-971e-6d7cf3e01506 tempest-ServerRescueTestJSONUnderV235-927744761 tempest-ServerRescueTestJSONUnderV235-927744761-project-member] Enqueued Resource ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 with Priority: HIGHEST for action security_group_members [ 953.811194] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0309a1e7-9ef7-401a-8b73-8ed732d1e19c with Priority: HIGHEST for action security_group_members [ 953.811334] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 with Priority: HIGHEST for action security_group_members [ 953.811611] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0309a1e7-9ef7-401a-8b73-8ed732d1e19c taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.811714] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0309a1e7-9ef7-401a-8b73-8ed732d1e19c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.811905] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c0ce237-8ae5-4e9f-857a-af422cd22902 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.811981] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.853392] env[69506]: INFO networking_nsxv3.common.synchronization [req-8c0e67ad-8d99-4972-8e3e-55d7fbcdf629 req-780199cc-f34f-477c-971e-6d7cf3e01506 tempest-ServerRescueTestJSONUnderV235-927744761 tempest-ServerRescueTestJSONUnderV235-927744761-project-member] Enqueued Resource ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 with Priority: HIGHEST for action security_group_rules [ 953.853876] env[69506]: INFO networking_nsxv3.common.synchronization [req-8c0e67ad-8d99-4972-8e3e-55d7fbcdf629 req-780199cc-f34f-477c-971e-6d7cf3e01506 tempest-ServerRescueTestJSONUnderV235-927744761 tempest-ServerRescueTestJSONUnderV235-927744761-project-member] Enqueued Resource ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 with Priority: HIGHEST for action security_group_members [ 953.854055] env[69506]: INFO networking_nsxv3.common.synchronization [req-8c0e67ad-8d99-4972-8e3e-55d7fbcdf629 req-780199cc-f34f-477c-971e-6d7cf3e01506 tempest-ServerRescueTestJSONUnderV235-927744761 tempest-ServerRescueTestJSONUnderV235-927744761-project-member] Enqueued Resource ID: b4d0ef17-87ed-494d-94b1-bf5678c7dbd4 with Priority: HIGHEST for action port [ 953.854591] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 with Priority: HIGHEST for action security_group_rules [ 953.854790] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 with Priority: HIGHEST for action security_group_members [ 953.854872] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d0ef17-87ed-494d-94b1-bf5678c7dbd4 with Priority: HIGHEST for action port [ 953.855213] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c0ce237-8ae5-4e9f-857a-af422cd22902 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.855283] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.855507] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c0ce237-8ae5-4e9f-857a-af422cd22902 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.855624] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.855818] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4d0ef17-87ed-494d-94b1-bf5678c7dbd4 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.855919] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4d0ef17-87ed-494d-94b1-bf5678c7dbd4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.855984] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4d0ef17-87ed-494d-94b1-bf5678c7dbd4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.856196] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4d0ef17-87ed-494d-94b1-bf5678c7dbd4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.856294] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4d0ef17-87ed-494d-94b1-bf5678c7dbd4',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.891752] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0309a1e7-9ef7-401a-8b73-8ed732d1e19c',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.897296] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c0ce237-8ae5-4e9f-857a-af422cd22902',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.970943] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('458c7186-d79f-4548-a2a0-95db0abbb880',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.163484] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 in Status: SUCCESS [ 954.163769] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.358390] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b4d0ef17-87ed-494d-94b1-bf5678c7dbd4 with status ACTIVE [ 954.358621] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.358832] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.358832] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.361019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.361019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.361019] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.361019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.361019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.361019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.361019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.361019] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.361019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.361019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.361019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.361019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.361422] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b4d0ef17-87ed-494d-94b1-bf5678c7dbd4 is going to be updated. [ 954.384739] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.384932] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.385014] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.385301] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.385301] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.385452] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4d0ef17-87ed-494d-94b1-bf5678c7dbd4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.394935] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.394935] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.394935] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.394935] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.397282] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.397282] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0309a1e7-9ef7-401a-8b73-8ed732d1e19c is going to be created. [ 954.398934] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.399009] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.399193] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.399331] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.399331] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.399411] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 is going to be updated. [ 954.428785] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.428974] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.429037] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.429229] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.429378] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.435472] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.435607] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.435678] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.435827] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.435952] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.445812] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0309a1e7-9ef7-401a-8b73-8ed732d1e19c in Status: UNINITIALIZED for 2s [ 954.446440] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 in Status: IN_PROGRESS for 2s [ 954.472898] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('458c7186-d79f-4548-a2a0-95db0abbb880',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.975787] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.976307] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.976498] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.976751] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.976852] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.976956] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 458c7186-d79f-4548-a2a0-95db0abbb880 is going to be updated. [ 955.004992] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.005166] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.005236] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.005440] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.005579] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.014467] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 458c7186-d79f-4548-a2a0-95db0abbb880 in Status: IN_PROGRESS for 2s [ 956.458841] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0309a1e7-9ef7-401a-8b73-8ed732d1e19c in Status: SUCCESS [ 956.459616] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0309a1e7-9ef7-401a-8b73-8ed732d1e19c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.460131] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 in Status: SUCCESS [ 956.460385] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.460618] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0309a1e7-9ef7-401a-8b73-8ed732d1e19c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.462198] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0309a1e7-9ef7-401a-8b73-8ed732d1e19c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.462487] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.462670] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.462775] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.463039] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.463176] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.463325] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0309a1e7-9ef7-401a-8b73-8ed732d1e19c',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.464558] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.464721] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.464968] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.465752] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.465870] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.466411] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.466468] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.466578] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c0ce237-8ae5-4e9f-857a-af422cd22902',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.973192] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.973192] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.973192] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.973192] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.973192] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.973192] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.973192] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.973192] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.973192] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.973192] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.973192] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0309a1e7-9ef7-401a-8b73-8ed732d1e19c is going to be deleted. [ 956.973192] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c0ce237-8ae5-4e9f-857a-af422cd22902',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.008724] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.011324] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.011324] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.011324] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.011324] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.011324] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0309a1e7-9ef7-401a-8b73-8ed732d1e19c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.011324] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0309a1e7-9ef7-401a-8b73-8ed732d1e19c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.011324] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0309a1e7-9ef7-401a-8b73-8ed732d1e19c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.011324] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.011324] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.011324] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.011324] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.011324] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.011324] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0309a1e7-9ef7-401a-8b73-8ed732d1e19c',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.032486] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 458c7186-d79f-4548-a2a0-95db0abbb880 in Status: SUCCESS [ 957.032702] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.480689] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c0ce237-8ae5-4e9f-857a-af422cd22902',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.514029] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.515307] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.515307] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.515307] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.515307] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.515307] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.515307] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.515307] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.515307] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.515307] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.515307] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0309a1e7-9ef7-401a-8b73-8ed732d1e19c already deleted. [ 957.515307] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0309a1e7-9ef7-401a-8b73-8ed732d1e19c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.515810] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0309a1e7-9ef7-401a-8b73-8ed732d1e19c',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.520461] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0309a1e7-9ef7-401a-8b73-8ed732d1e19c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.520461] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0309a1e7-9ef7-401a-8b73-8ed732d1e19c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.520601] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.520601] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.520689] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.520800] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.520969] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.520969] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0309a1e7-9ef7-401a-8b73-8ed732d1e19c',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.983054] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.983333] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.983457] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.983722] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.983860] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.983995] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 is going to be updated. [ 958.014084] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.014914] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.015066] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.015421] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.016033] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.019913] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0309a1e7-9ef7-401a-8b73-8ed732d1e19c',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.024479] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 in Status: IN_PROGRESS for 2s [ 958.025174] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.025369] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.025577] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.026018] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.026169] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.026430] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.026596] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.027014] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.027014] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.027014] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.027133] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0309a1e7-9ef7-401a-8b73-8ed732d1e19c already deleted. [ 958.027377] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0309a1e7-9ef7-401a-8b73-8ed732d1e19c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.370711] env[69506]: INFO networking_nsxv3.common.synchronization [req-53366e52-ffba-494f-9adc-2d1804d6344b req-8d9b9f47-4d9e-48a2-b6d8-d8a85f4fc573 tempest-ImagesTestJSON-821230832 tempest-ImagesTestJSON-821230832-project-member] Enqueued Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_members [ 958.370711] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_members [ 958.370711] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0db323-2ed4-4f6a-a30a-405b16133cb2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.370711] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.370711] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.370711] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.370711] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.370711] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.370711] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.371287] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.372135] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.372135] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.523505] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0309a1e7-9ef7-401a-8b73-8ed732d1e19c: rpc.has_security_group_logging(os_id): False [ 958.542196] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.542885] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.542885] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.542885] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.542885] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.543068] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.543068] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.543166] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.543240] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.543318] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.543485] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0309a1e7-9ef7-401a-8b73-8ed732d1e19c is going to be created. [ 958.560138] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/0309a1e7-9ef7-401a-8b73-8ed732d1e19c], does not exist path=[/infra/domains/default/groups/0309a1e7-9ef7-401a-8b73-8ed732d1e19c]."\n}' [ 958.560401] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0309a1e7-9ef7-401a-8b73-8ed732d1e19c failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/0309a1e7-9ef7-401a-8b73-8ed732d1e19c [ 958.560401] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 958.643019] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.643019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.643019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.643019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.644517] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.644950] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.645149] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.645264] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.646446] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.647419] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.648381] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.648563] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.648686] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.648943] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.649784] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.649784] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0309a1e7-9ef7-401a-8b73-8ed732d1e19c is going to be created. [ 958.668273] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/0309a1e7-9ef7-401a-8b73-8ed732d1e19c], does not exist path=[/infra/domains/default/groups/0309a1e7-9ef7-401a-8b73-8ed732d1e19c]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/0309a1e7-9ef7-401a-8b73-8ed732d1e19c [ 958.668478] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0309a1e7-9ef7-401a-8b73-8ed732d1e19c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.669104] env[69506]: Traceback (most recent call last): [ 958.669104] env[69506]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 958.669104] env[69506]: return func(*args, **kwargs) [ 958.669104] env[69506]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 958.669104] env[69506]: res.raise_for_status() [ 958.669104] env[69506]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 958.669104] env[69506]: raise HTTPError(http_error_msg, response=self) [ 958.669104] env[69506]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/0309a1e7-9ef7-401a-8b73-8ed732d1e19c [ 958.669104] env[69506]: During handling of the above exception, another exception occurred: [ 958.669104] env[69506]: Traceback (most recent call last): [ 958.669104] env[69506]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 958.669104] env[69506]: listener.cb(fileno) [ 958.669104] env[69506]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 958.669104] env[69506]: result = function(*args, **kwargs) [ 958.669104] env[69506]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 958.669104] env[69506]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 958.669104] env[69506]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 958.669104] env[69506]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 958.669104] env[69506]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 958.669104] env[69506]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 958.669104] env[69506]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 958.669104] env[69506]: res.raise_for_status() [ 958.669104] env[69506]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 958.669104] env[69506]: raise HTTPError(http_error_msg, response=self) [ 958.669104] env[69506]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/0309a1e7-9ef7-401a-8b73-8ed732d1e19c [ 958.669104] env[69506]: Removing descriptor: 27 [ 958.879141] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.879141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.879281] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.879410] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.900219] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.900504] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.900643] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.900709] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.900910] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.900987] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.901090] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 is going to be updated. [ 958.931714] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.931939] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.932030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.932325] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.932488] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.941220] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: IN_PROGRESS for 2s [ 959.083540] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-612 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.083655] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-612" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.083843] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-612" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.085214] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-612" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.085214] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.085214] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.085214] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.085214] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.086439] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.086702] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 959.087124] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 959.087293] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 959.089019] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 959.089019] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 959.089019] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 959.089019] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 959.105054] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 959.105318] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 959.105394] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 959.105563] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-612" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.106008] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-270b3ab2-4673-4463-9fb1-ee296c8d8896 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.106417] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-270b3ab2-4673-4463-9fb1-ee296c8d8896" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.106638] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-270b3ab2-4673-4463-9fb1-ee296c8d8896" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.106998] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-270b3ab2-4673-4463-9fb1-ee296c8d8896" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.107181] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('270b3ab2-4673-4463-9fb1-ee296c8d8896',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.430521] env[69506]: INFO networking_nsxv3.common.synchronization [req-127adf4f-9d19-4fd2-ac26-6623db5eb86d req-9805074a-3fc2-4cf9-98b7-50b23933f20d tempest-ServersWithSpecificFlavorTestJSON-989278643 tempest-ServersWithSpecificFlavorTestJSON-989278643-project-member] Enqueued Resource ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 with Priority: HIGHEST for action security_group_members [ 959.432688] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 with Priority: HIGHEST for action security_group_members [ 959.433293] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6908af9-f839-40b2-9ca2-1fd554ee1d78 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.433669] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.436021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.436021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.436021] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.436021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.436021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.436021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.436021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.436021] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6908af9-f839-40b2-9ca2-1fd554ee1d78',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.613272] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.613272] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.613272] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.613272] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.613272] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.613272] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 270b3ab2-4673-4463-9fb1-ee296c8d8896 not found, creating... [ 959.613272] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.613272] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.613272] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.615063] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.615063] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.615063] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.615063] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.615267] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.615481] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.615539] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.615790] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 270b3ab2-4673-4463-9fb1-ee296c8d8896 is going to be created. [ 959.639170] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.639833] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.639995] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.640317] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.640654] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.641129] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-270b3ab2-4673-4463-9fb1-ee296c8d8896" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.940479] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.940977] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.940977] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.941392] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.960597] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.960854] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.961347] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.961347] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.961347] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.961897] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.962171] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 is going to be updated. [ 959.991440] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.992232] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.992232] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.992232] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.992232] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.001871] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 in Status: IN_PROGRESS for 2s [ 960.033595] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 in Status: SUCCESS [ 960.033595] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.033595] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.034310] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.034407] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.035525] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.035601] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.035799] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.035870] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.035964] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.036085] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c0ce237-8ae5-4e9f-857a-af422cd22902',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.037114] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.038183] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.038455] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.038537] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.038537] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.038696] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.038777] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.038868] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c0ce237-8ae5-4e9f-857a-af422cd22902',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.060031] env[69506]: INFO networking_nsxv3.common.synchronization [None req-d1335e1e-53ff-4425-bf8f-135efbd94afb tempest-AttachVolumeNegativeTest-402732870 tempest-AttachVolumeNegativeTest-402732870-project-member] Enqueued Resource ID: 23c9b5f8-1cff-4d68-a385-35487b841eb9 with Priority: HIGHEST for action security_group_rules [ 960.061708] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23c9b5f8-1cff-4d68-a385-35487b841eb9 with Priority: HIGHEST for action security_group_rules [ 960.061708] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23c9b5f8-1cff-4d68-a385-35487b841eb9 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.061708] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23c9b5f8-1cff-4d68-a385-35487b841eb9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.061708] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23c9b5f8-1cff-4d68-a385-35487b841eb9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.061869] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23c9b5f8-1cff-4d68-a385-35487b841eb9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.061958] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23c9b5f8-1cff-4d68-a385-35487b841eb9',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.269296] env[69506]: INFO networking_nsxv3.common.synchronization [None req-9aefd1fe-9457-4e54-9cca-2f32f511ef6a tempest-AttachVolumeNegativeTest-402732870 tempest-AttachVolumeNegativeTest-402732870-project-member] Enqueued Resource ID: 23c9b5f8-1cff-4d68-a385-35487b841eb9 with Priority: HIGHEST for action security_group_rules [ 960.269953] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23c9b5f8-1cff-4d68-a385-35487b841eb9 with Priority: HIGHEST for action security_group_rules [ 960.270175] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23c9b5f8-1cff-4d68-a385-35487b841eb9 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.270302] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23c9b5f8-1cff-4d68-a385-35487b841eb9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.540515] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c0ce237-8ae5-4e9f-857a-af422cd22902 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.540609] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.540863] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c0ce237-8ae5-4e9f-857a-af422cd22902',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.582415] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.582586] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.582650] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.582845] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.583117] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.583117] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23c9b5f8-1cff-4d68-a385-35487b841eb9 already deleted. [ 960.583117] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23c9b5f8-1cff-4d68-a385-35487b841eb9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.583284] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23c9b5f8-1cff-4d68-a385-35487b841eb9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.583454] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23c9b5f8-1cff-4d68-a385-35487b841eb9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.583517] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23c9b5f8-1cff-4d68-a385-35487b841eb9',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.859996] env[69506]: INFO networking_nsxv3.common.synchronization [req-004785bb-b84e-457b-b6fd-5501e5239f4b req-29ff78d7-a341-42ca-9a9c-1a5d5796b857 tempest-ServerRescueTestJSONUnderV235-927744761 tempest-ServerRescueTestJSONUnderV235-927744761-project-member] Enqueued Resource ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 with Priority: HIGHEST for action security_group_members [ 960.859996] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 with Priority: HIGHEST for action security_group_members [ 960.860340] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c0ce237-8ae5-4e9f-857a-af422cd22902 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.860444] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.950610] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: SUCCESS [ 960.950746] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 deletion is rescheduled due to dependency. [ 960.950931] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.034848] env[69506]: INFO networking_nsxv3.common.synchronization [req-53366e52-ffba-494f-9adc-2d1804d6344b req-1a78971d-62de-425a-8cf6-fdb20dc40b8c service nova] Enqueued Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_rules [ 961.035048] env[69506]: INFO networking_nsxv3.common.synchronization [req-53366e52-ffba-494f-9adc-2d1804d6344b req-1a78971d-62de-425a-8cf6-fdb20dc40b8c service nova] Enqueued Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_members [ 961.035194] env[69506]: INFO networking_nsxv3.common.synchronization [req-53366e52-ffba-494f-9adc-2d1804d6344b req-1a78971d-62de-425a-8cf6-fdb20dc40b8c service nova] Enqueued Resource ID: 270b3ab2-4673-4463-9fb1-ee296c8d8896 with Priority: HIGHEST for action port [ 961.035412] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_rules [ 961.035532] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_members [ 961.035631] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 270b3ab2-4673-4463-9fb1-ee296c8d8896 with Priority: HIGHEST for action port [ 961.036490] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d0db323-2ed4-4f6a-a30a-405b16133cb2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.036578] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.036646] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.036841] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.036917] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.037751] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0db323-2ed4-4f6a-a30a-405b16133cb2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.037857] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.037922] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.038093] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.038236] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.038326] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.038385] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.038519] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.038600] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.038686] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.039387] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-270b3ab2-4673-4463-9fb1-ee296c8d8896 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.039497] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-270b3ab2-4673-4463-9fb1-ee296c8d8896" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.039560] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-270b3ab2-4673-4463-9fb1-ee296c8d8896" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.039735] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-270b3ab2-4673-4463-9fb1-ee296c8d8896" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.039849] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('270b3ab2-4673-4463-9fb1-ee296c8d8896',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.046238] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c0ce237-8ae5-4e9f-857a-af422cd22902',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.107561] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.107730] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.107781] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.108471] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.108573] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.108677] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23c9b5f8-1cff-4d68-a385-35487b841eb9 already deleted. [ 961.108763] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23c9b5f8-1cff-4d68-a385-35487b841eb9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.541701] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.542784] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0db323-2ed4-4f6a-a30a-405b16133cb2 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.542989] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.543411] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 270b3ab2-4673-4463-9fb1-ee296c8d8896 with status ACTIVE [ 961.547624] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.547624] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.547624] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.547624] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.547624] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.547861] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.547915] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.547977] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.548348] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.548434] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.548623] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.548719] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.548782] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.548930] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.549020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.549104] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 270b3ab2-4673-4463-9fb1-ee296c8d8896 is going to be updated. [ 961.550241] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.550348] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.550416] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.550565] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.551960] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.552098] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 is going to be updated. [ 961.574746] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.574881] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.574952] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.575209] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.575286] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.575446] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-270b3ab2-4673-4463-9fb1-ee296c8d8896" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.657170] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.657421] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.657421] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.657615] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.657767] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.671034] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 in Status: IN_PROGRESS for 2s [ 962.012338] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 in Status: SUCCESS [ 962.012578] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 deletion is rescheduled due to dependency. [ 962.012665] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.045050] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.448910] env[69506]: INFO networking_nsxv3.common.synchronization [None req-676447a4-c7a9-4385-a5c0-75b99218b79a None None] Enqueued Resource ID: e6d3df77-1eb4-4c0b-83ea-cf6c0705fd14 with Priority: HIGHEST for action port [ 962.449486] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6d3df77-1eb4-4c0b-83ea-cf6c0705fd14 with Priority: HIGHEST for action port [ 962.450299] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6d3df77-1eb4-4c0b-83ea-cf6c0705fd14 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.450299] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6d3df77-1eb4-4c0b-83ea-cf6c0705fd14" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.450299] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6d3df77-1eb4-4c0b-83ea-cf6c0705fd14" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.450299] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6d3df77-1eb4-4c0b-83ea-cf6c0705fd14" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.450483] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6d3df77-1eb4-4c0b-83ea-cf6c0705fd14',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.548338] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.548426] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.548461] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.548889] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.548889] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.549051] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 is going to be updated. [ 962.557250] env[69506]: INFO networking_nsxv3.common.synchronization [None req-7f8b9acf-c31e-4bd9-89a6-1b84d7c142b4 None None] Enqueued Resource ID: 27551e83-f764-4491-a721-5148520cb913 with Priority: HIGHEST for action port [ 962.557250] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27551e83-f764-4491-a721-5148520cb913 with Priority: HIGHEST for action port [ 962.557250] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-27551e83-f764-4491-a721-5148520cb913 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.557250] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27551e83-f764-4491-a721-5148520cb913" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.557250] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27551e83-f764-4491-a721-5148520cb913" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.557250] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27551e83-f764-4491-a721-5148520cb913" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.557250] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27551e83-f764-4491-a721-5148520cb913',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.577312] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.577531] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.577630] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.577925] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.578118] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.588868] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: IN_PROGRESS for 2s [ 962.953041] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e6d3df77-1eb4-4c0b-83ea-cf6c0705fd14 [ 962.953465] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.953682] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.953839] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.956334] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.956334] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.956334] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e6d3df77-1eb4-4c0b-83ea-cf6c0705fd14 already deleted. [ 962.956334] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6d3df77-1eb4-4c0b-83ea-cf6c0705fd14" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.063376] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 27551e83-f764-4491-a721-5148520cb913 [ 963.063706] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.063807] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.063863] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.064087] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.064180] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.064314] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:27551e83-f764-4491-a721-5148520cb913 already deleted. [ 963.064384] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27551e83-f764-4491-a721-5148520cb913" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.681068] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 in Status: SUCCESS [ 963.682726] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.682910] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.683156] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.683350] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.683467] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.683541] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.683686] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.683769] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.683869] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c0ce237-8ae5-4e9f-857a-af422cd22902',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.189289] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.189289] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.189289] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.189289] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.211165] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.211330] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.211444] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.211511] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.211704] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.211790] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.211875] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 is going to be updated. [ 964.235116] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.235272] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.235343] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.235556] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.235715] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.244244] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 in Status: IN_PROGRESS for 2s [ 964.597830] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: SUCCESS [ 964.598820] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.598820] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.598820] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.598820] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.598820] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.598820] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.599304] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.599304] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.599304] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.599304] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.067143] env[69506]: INFO networking_nsxv3.common.synchronization [None req-49ddc0a3-d153-43c9-bb30-f575f51346f5 None None] Enqueued Resource ID: 1a48d32d-1032-499b-8bce-8a8ff50006ee with Priority: HIGHEST for action port [ 965.068344] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a48d32d-1032-499b-8bce-8a8ff50006ee with Priority: HIGHEST for action port [ 965.068344] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a48d32d-1032-499b-8bce-8a8ff50006ee taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.068624] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a48d32d-1032-499b-8bce-8a8ff50006ee" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.068624] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a48d32d-1032-499b-8bce-8a8ff50006ee" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.068879] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a48d32d-1032-499b-8bce-8a8ff50006ee" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.068983] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a48d32d-1032-499b-8bce-8a8ff50006ee',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.103380] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0db323-2ed4-4f6a-a30a-405b16133cb2 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.103650] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.103650] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.104022] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.104228] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.104361] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.104468] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.104826] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.104826] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.104826] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.105051] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0db323-2ed4-4f6a-a30a-405b16133cb2 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.105142] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.105142] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.105351] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.107432] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.107432] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.107432] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.107432] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.107432] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.107432] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.107432] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.127733] env[69506]: INFO networking_nsxv3.common.synchronization [req-805dcb77-d085-40ed-bf57-171a65258fdb req-785b84ba-415d-4369-b139-cc5fa3cdf979 tempest-ServerActionsTestOtherB-347258904 tempest-ServerActionsTestOtherB-347258904-project-member] Enqueued Resource ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 with Priority: HIGHEST for action security_group_members [ 965.131290] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 with Priority: HIGHEST for action security_group_members [ 965.131290] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.131290] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.131290] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.131290] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.131290] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.131290] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.131290] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.131290] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.131290] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.131290] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fca9cd47-c1fb-4023-8f12-fa1b22a98fd8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.574513] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1a48d32d-1032-499b-8bce-8a8ff50006ee [ 965.574757] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.574861] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.575269] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.575269] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.575269] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.575598] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1a48d32d-1032-499b-8bce-8a8ff50006ee already deleted. [ 965.575598] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a48d32d-1032-499b-8bce-8a8ff50006ee" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.608265] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d0db323-2ed4-4f6a-a30a-405b16133cb2: rpc.has_security_group_logging(os_id): False [ 965.629418] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.629563] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.629685] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.630082] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.630082] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.630242] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.630336] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.630395] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.630679] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.630679] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.630868] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.630948] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.630994] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.631134] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.631207] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.632034] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.632034] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.632034] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.632034] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.632034] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.632034] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 is going to be updated. [ 965.635717] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.635853] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.635911] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.636132] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.658373] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.658373] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.658373] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.658373] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.658595] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.659473] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.659473] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 is going to be updated. [ 965.693275] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.693275] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.693275] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.693275] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.693585] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.705174] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 in Status: IN_PROGRESS for 2s [ 965.707663] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.708513] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.710036] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.710036] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.710036] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.723387] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: IN_PROGRESS for 2s [ 965.750353] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-697 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.750576] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-697" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.751775] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-697" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.751775] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-697" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.751775] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.752179] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.752387] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.752782] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.752950] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.753339] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 965.754288] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 965.754288] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 965.754288] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 965.754288] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 965.754288] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 965.754619] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 965.783342] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 965.783533] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 965.783934] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 965.783934] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-697" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.784353] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-1fb374b4-aa8f-4c53-a213-cb54c9ed03e0 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.785521] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-1fb374b4-aa8f-4c53-a213-cb54c9ed03e0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.785824] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-1fb374b4-aa8f-4c53-a213-cb54c9ed03e0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.786244] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-1fb374b4-aa8f-4c53-a213-cb54c9ed03e0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.786453] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fb374b4-aa8f-4c53-a213-cb54c9ed03e0',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.981891] env[69506]: INFO networking_nsxv3.common.synchronization [None req-7e6a198c-ad1c-4142-a811-b299e9cdc64b None None] Enqueued Resource ID: 13290e97-8bbf-4f0f-ba17-56edd7cccdd7 with Priority: HIGHEST for action port [ 965.982792] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13290e97-8bbf-4f0f-ba17-56edd7cccdd7 with Priority: HIGHEST for action port [ 965.983151] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-13290e97-8bbf-4f0f-ba17-56edd7cccdd7 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.983285] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13290e97-8bbf-4f0f-ba17-56edd7cccdd7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.983355] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13290e97-8bbf-4f0f-ba17-56edd7cccdd7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.983633] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13290e97-8bbf-4f0f-ba17-56edd7cccdd7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.983753] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13290e97-8bbf-4f0f-ba17-56edd7cccdd7',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.084251] env[69506]: INFO networking_nsxv3.common.synchronization [None req-83256e85-3d4d-4813-9a36-de97958a8475 None None] Enqueued Resource ID: 091cac3c-1b5d-42ec-bbc3-f5f0dbe355ea with Priority: HIGHEST for action port [ 966.084251] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 091cac3c-1b5d-42ec-bbc3-f5f0dbe355ea with Priority: HIGHEST for action port [ 966.084251] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-091cac3c-1b5d-42ec-bbc3-f5f0dbe355ea taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.084251] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-091cac3c-1b5d-42ec-bbc3-f5f0dbe355ea" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.084251] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-091cac3c-1b5d-42ec-bbc3-f5f0dbe355ea" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.084251] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-091cac3c-1b5d-42ec-bbc3-f5f0dbe355ea" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.084623] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('091cac3c-1b5d-42ec-bbc3-f5f0dbe355ea',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.255042] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 in Status: SUCCESS [ 966.255042] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 deletion is rescheduled due to dependency. [ 966.255042] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.255042] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.255042] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.255042] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.255042] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.255042] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.255042] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.255042] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.255042] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.255042] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c0ce237-8ae5-4e9f-857a-af422cd22902 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.255042] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.255042] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.255042] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.255042] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.255042] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.255042] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.255042] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.255711] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.255711] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.255711] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c0ce237-8ae5-4e9f-857a-af422cd22902',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.257136] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.257462] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.257721] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.257964] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.258331] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.258575] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.258763] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.258938] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c0ce237-8ae5-4e9f-857a-af422cd22902',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.292031] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.292031] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.292031] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.292031] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.292031] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.292031] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 1fb374b4-aa8f-4c53-a213-cb54c9ed03e0 not found, creating... [ 966.292031] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.292031] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.292031] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.292031] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.292031] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.292476] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.292476] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.292476] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.292476] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.292476] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.292476] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 1fb374b4-aa8f-4c53-a213-cb54c9ed03e0 is going to be created. [ 966.314040] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.314040] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.314040] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.314040] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.314040] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.314040] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-1fb374b4-aa8f-4c53-a213-cb54c9ed03e0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.488815] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 13290e97-8bbf-4f0f-ba17-56edd7cccdd7 [ 966.488815] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.488947] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.488947] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.489263] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.489447] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.489837] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:13290e97-8bbf-4f0f-ba17-56edd7cccdd7 already deleted. [ 966.489837] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13290e97-8bbf-4f0f-ba17-56edd7cccdd7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.587780] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 091cac3c-1b5d-42ec-bbc3-f5f0dbe355ea [ 966.591149] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.592728] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.593674] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.593674] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.593674] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.593674] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:091cac3c-1b5d-42ec-bbc3-f5f0dbe355ea already deleted. [ 966.593674] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-091cac3c-1b5d-42ec-bbc3-f5f0dbe355ea" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.761298] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c0ce237-8ae5-4e9f-857a-af422cd22902: rpc.has_security_group_logging(os_id): False [ 966.762706] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.762949] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.762949] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.763193] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.763282] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.763515] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.763657] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.763709] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.763922] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.763998] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.764111] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 is going to be updated. [ 966.784993] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.785325] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.785325] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.785510] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.785601] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.785900] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.786025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.786118] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.787251] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.787251] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.787251] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.787251] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.787251] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.787251] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.787251] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.787251] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.787251] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.787784] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.787784] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.787784] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.787784] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 is going to be updated. [ 966.801563] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.801563] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.801563] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.801563] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.801563] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.812020] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 in Status: IN_PROGRESS for 2s [ 966.880456] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.882903] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.882903] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.882903] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.882903] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.895158] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 in Status: IN_PROGRESS for 2s [ 967.350515] env[69506]: INFO networking_nsxv3.common.synchronization [req-805dcb77-d085-40ed-bf57-171a65258fdb req-6ebdb95a-d21e-4d1a-b547-157ac997c340 service nova] Enqueued Resource ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 with Priority: HIGHEST for action security_group_rules [ 967.350704] env[69506]: INFO networking_nsxv3.common.synchronization [req-805dcb77-d085-40ed-bf57-171a65258fdb req-6ebdb95a-d21e-4d1a-b547-157ac997c340 service nova] Enqueued Resource ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 with Priority: HIGHEST for action security_group_members [ 967.350879] env[69506]: INFO networking_nsxv3.common.synchronization [req-805dcb77-d085-40ed-bf57-171a65258fdb req-6ebdb95a-d21e-4d1a-b547-157ac997c340 service nova] Enqueued Resource ID: 1fb374b4-aa8f-4c53-a213-cb54c9ed03e0 with Priority: HIGHEST for action port [ 967.351140] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 with Priority: HIGHEST for action security_group_rules [ 967.351342] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 with Priority: HIGHEST for action security_group_members [ 967.351418] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fb374b4-aa8f-4c53-a213-cb54c9ed03e0 with Priority: HIGHEST for action port [ 967.351900] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.352923] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.352923] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.352923] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.353067] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fca9cd47-c1fb-4023-8f12-fa1b22a98fd8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.354345] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.354345] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.354345] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-1fb374b4-aa8f-4c53-a213-cb54c9ed03e0 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.354345] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1fb374b4-aa8f-4c53-a213-cb54c9ed03e0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.354345] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1fb374b4-aa8f-4c53-a213-cb54c9ed03e0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.355388] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1fb374b4-aa8f-4c53-a213-cb54c9ed03e0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.355472] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fb374b4-aa8f-4c53-a213-cb54c9ed03e0',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.716931] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 in Status: SUCCESS [ 967.717320] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 deletion is rescheduled due to dependency. [ 967.717320] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.718049] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.718049] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.718049] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.718404] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.718404] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.718558] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.718627] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.718741] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fca9cd47-c1fb-4023-8f12-fa1b22a98fd8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.737835] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: SUCCESS [ 967.737835] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.859102] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.859242] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.859429] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1fb374b4-aa8f-4c53-a213-cb54c9ed03e0 with status ACTIVE [ 967.859594] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.859717] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.859784] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.859981] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.860115] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.860286] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.860396] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.860446] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.860583] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.860662] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.860843] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.860936] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.860997] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.861150] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.861222] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.861304] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1fb374b4-aa8f-4c53-a213-cb54c9ed03e0 is going to be updated. [ 967.883263] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.883363] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.883439] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.883632] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.883758] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.883921] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1fb374b4-aa8f-4c53-a213-cb54c9ed03e0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.223854] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fca9cd47-c1fb-4023-8f12-fa1b22a98fd8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.514198] env[69506]: INFO networking_nsxv3.common.synchronization [None req-c97c51ba-2ef3-4941-85de-7cbfc16e0f06 None None] Enqueued Resource ID: 881ca16c-beb0-4011-a0c8-dce0b7c788e3 with Priority: HIGHEST for action port [ 968.514198] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 881ca16c-beb0-4011-a0c8-dce0b7c788e3 with Priority: HIGHEST for action port [ 968.514198] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-881ca16c-beb0-4011-a0c8-dce0b7c788e3 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.514397] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-881ca16c-beb0-4011-a0c8-dce0b7c788e3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.514397] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-881ca16c-beb0-4011-a0c8-dce0b7c788e3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.514615] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-881ca16c-beb0-4011-a0c8-dce0b7c788e3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.514702] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('881ca16c-beb0-4011-a0c8-dce0b7c788e3',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.726350] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fca9cd47-c1fb-4023-8f12-fa1b22a98fd8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.820699] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 in Status: SUCCESS [ 968.820699] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 deletion is rescheduled due to dependency. [ 968.820699] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.909799] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 in Status: SUCCESS [ 968.910079] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.910386] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.910715] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.910812] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c0ce237-8ae5-4e9f-857a-af422cd22902',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.023495] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 881ca16c-beb0-4011-a0c8-dce0b7c788e3 [ 969.023495] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.023774] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.023834] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.024104] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.024228] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.024333] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:881ca16c-beb0-4011-a0c8-dce0b7c788e3 already deleted. [ 969.024443] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-881ca16c-beb0-4011-a0c8-dce0b7c788e3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.232464] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.232630] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.233177] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.233177] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.233177] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.233177] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 is going to be updated. [ 969.261090] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.261249] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.261321] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.261504] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.261644] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.270441] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 in Status: IN_PROGRESS for 2s [ 969.431354] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.431503] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.431549] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.432202] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.432202] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.432202] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c0ce237-8ae5-4e9f-857a-af422cd22902 is going to be deleted. [ 969.481759] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.481942] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.482065] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.482254] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.482361] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.482509] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c0ce237-8ae5-4e9f-857a-af422cd22902" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.643233] env[69506]: INFO networking_nsxv3.common.synchronization [req-1b32b938-8de2-4eb7-926c-9e913330c8ba req-5a5faa8a-b488-4284-8ba3-18ae254a6564 tempest-ListImageFiltersTestJSON-525149621 tempest-ListImageFiltersTestJSON-525149621-project-member] Enqueued Resource ID: 458c7186-d79f-4548-a2a0-95db0abbb880 with Priority: HIGHEST for action security_group_members [ 969.643843] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 458c7186-d79f-4548-a2a0-95db0abbb880 with Priority: HIGHEST for action security_group_members [ 969.644261] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-458c7186-d79f-4548-a2a0-95db0abbb880 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.644921] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.644921] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.644921] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.644921] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.645111] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.645111] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.645338] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.648256] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.648256] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('458c7186-d79f-4548-a2a0-95db0abbb880',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.705398] env[69506]: INFO networking_nsxv3.common.synchronization [req-821b0f1a-2d4e-4e26-bbb7-952043838ccb req-4cb30004-b277-4297-a0cc-e1ac98668594 tempest-ServersTestJSON-1801092994 tempest-ServersTestJSON-1801092994-project-member] Enqueued Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 969.705922] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 969.706273] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.706403] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.706486] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.706708] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.706869] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.706986] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.708201] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.708201] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.708343] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.708552] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.150470] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.150470] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.150470] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.150470] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.169505] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.169827] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.169993] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.170080] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.170285] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.170379] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.170469] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 458c7186-d79f-4548-a2a0-95db0abbb880 is going to be updated. [ 970.212619] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.219373] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.219523] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.219594] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.219873] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.220013] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.228955] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 458c7186-d79f-4548-a2a0-95db0abbb880 in Status: IN_PROGRESS for 2s [ 970.326284] env[69506]: INFO networking_nsxv3.common.synchronization [req-45d2db25-54ab-4b57-90d2-bcf713c264c3 req-2dd69b4e-094d-480a-a0aa-508a40c65606 tempest-ImagesOneServerNegativeTestJSON-1660335094 tempest-ImagesOneServerNegativeTestJSON-1660335094-project-member] Enqueued Resource ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 with Priority: HIGHEST for action security_group_members [ 970.326466] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 with Priority: HIGHEST for action security_group_members [ 970.327381] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bc29505-f5b4-4554-85b9-541273bd8da3 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.327520] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.327599] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.327774] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.327938] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.328053] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.328113] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.328270] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.328357] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.328672] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bc29505-f5b4-4554-85b9-541273bd8da3',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.528159] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-54 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.528159] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-54" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.528159] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-54" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.528159] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-54" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.528159] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.528159] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.528159] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.528159] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.528782] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.529108] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 970.529264] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 970.529438] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 970.529580] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 970.529885] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 970.529885] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 970.530035] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 970.559823] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 970.560667] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 970.560667] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 970.560667] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-54" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.560842] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-2ca269b5-02b9-467b-bbe8-aeb1d1c90e45 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.560915] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-2ca269b5-02b9-467b-bbe8-aeb1d1c90e45" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.561178] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-2ca269b5-02b9-467b-bbe8-aeb1d1c90e45" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.561554] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-2ca269b5-02b9-467b-bbe8-aeb1d1c90e45" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.561554] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ca269b5-02b9-467b-bbe8-aeb1d1c90e45',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.714701] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.832514] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.832681] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.832758] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.832977] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.853145] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.853427] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.853543] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.853732] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.853834] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.853910] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.853985] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 is going to be updated. [ 970.879582] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.879841] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.879880] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.880068] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.880223] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.887711] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 in Status: IN_PROGRESS for 2s [ 971.068154] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.068154] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.068154] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.068154] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.068154] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.070309] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 2ca269b5-02b9-467b-bbe8-aeb1d1c90e45 not found, creating... [ 971.070884] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.071491] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.071491] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.071881] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.072186] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.072805] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.073065] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.073295] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.073689] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.074399] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.074399] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 2ca269b5-02b9-467b-bbe8-aeb1d1c90e45 is going to be created. [ 971.094708] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.095151] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.095431] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.095888] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.099030] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.099030] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-2ca269b5-02b9-467b-bbe8-aeb1d1c90e45" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.219256] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.219256] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.219256] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.219256] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.221683] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.221683] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc is going to be updated. [ 971.261371] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.261607] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.261744] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.263088] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.263088] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.275563] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: IN_PROGRESS for 2s [ 971.286080] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 in Status: SUCCESS [ 971.286811] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.288037] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.288037] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.288037] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.288037] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.288037] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.288464] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.288464] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.288856] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.289021] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fca9cd47-c1fb-4023-8f12-fa1b22a98fd8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.791037] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fca9cd47-c1fb-4023-8f12-fa1b22a98fd8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.842970] env[69506]: INFO networking_nsxv3.common.synchronization [req-821b0f1a-2d4e-4e26-bbb7-952043838ccb req-b34ce129-1b80-40a9-83d8-1d43a3924b20 service nova] Enqueued Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_rules [ 971.843176] env[69506]: INFO networking_nsxv3.common.synchronization [req-821b0f1a-2d4e-4e26-bbb7-952043838ccb req-b34ce129-1b80-40a9-83d8-1d43a3924b20 service nova] Enqueued Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 971.843317] env[69506]: INFO networking_nsxv3.common.synchronization [req-821b0f1a-2d4e-4e26-bbb7-952043838ccb req-b34ce129-1b80-40a9-83d8-1d43a3924b20 service nova] Enqueued Resource ID: 2ca269b5-02b9-467b-bbe8-aeb1d1c90e45 with Priority: HIGHEST for action port [ 971.843528] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_rules [ 971.843660] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 971.843762] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ca269b5-02b9-467b-bbe8-aeb1d1c90e45 with Priority: HIGHEST for action port [ 971.844383] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.844469] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.844536] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.844764] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.846019] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.849536] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.849627] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.849803] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ca269b5-02b9-467b-bbe8-aeb1d1c90e45 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.849914] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ca269b5-02b9-467b-bbe8-aeb1d1c90e45" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.849966] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ca269b5-02b9-467b-bbe8-aeb1d1c90e45" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.850211] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ca269b5-02b9-467b-bbe8-aeb1d1c90e45" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.850259] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ca269b5-02b9-467b-bbe8-aeb1d1c90e45',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.931126] env[69506]: INFO networking_nsxv3.common.synchronization [None req-eebbb515-28fb-4485-9c77-fab48a8e4ca7 None None] Enqueued Resource ID: fb75cc0b-8db4-4619-bf9e-cad848071f27 with Priority: HIGHEST for action port [ 971.931631] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb75cc0b-8db4-4619-bf9e-cad848071f27 with Priority: HIGHEST for action port [ 971.931934] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb75cc0b-8db4-4619-bf9e-cad848071f27 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.933610] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb75cc0b-8db4-4619-bf9e-cad848071f27" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.933707] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb75cc0b-8db4-4619-bf9e-cad848071f27" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.933952] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb75cc0b-8db4-4619-bf9e-cad848071f27" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.934053] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb75cc0b-8db4-4619-bf9e-cad848071f27',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.223067] env[69506]: INFO networking_nsxv3.common.synchronization [None req-0622f864-435d-49b6-8d5c-9ef27fad9273 None None] Enqueued Resource ID: 03b95f4c-deff-4e4f-be1a-de4b13c8cca7 with Priority: HIGHEST for action port [ 972.223584] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03b95f4c-deff-4e4f-be1a-de4b13c8cca7 with Priority: HIGHEST for action port [ 972.224351] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-03b95f4c-deff-4e4f-be1a-de4b13c8cca7 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.224351] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03b95f4c-deff-4e4f-be1a-de4b13c8cca7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.226914] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03b95f4c-deff-4e4f-be1a-de4b13c8cca7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.227032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03b95f4c-deff-4e4f-be1a-de4b13c8cca7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.227110] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03b95f4c-deff-4e4f-be1a-de4b13c8cca7',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.236918] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 458c7186-d79f-4548-a2a0-95db0abbb880 in Status: SUCCESS [ 972.237122] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 458c7186-d79f-4548-a2a0-95db0abbb880 deletion is rescheduled due to dependency. [ 972.237235] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.293677] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fca9cd47-c1fb-4023-8f12-fa1b22a98fd8: rpc.has_security_group_logging(os_id): False [ 972.316731] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.317192] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.317327] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.317492] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.317614] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.317976] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.317976] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.318134] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.322022] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.322022] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.322022] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 is going to be updated. [ 972.351633] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.351852] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.355908] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2ca269b5-02b9-467b-bbe8-aeb1d1c90e45 with status ACTIVE [ 972.355908] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.355908] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.355908] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.355908] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.355908] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.355908] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.355908] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.355908] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.355908] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.355908] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.355908] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.355908] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.355908] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.355908] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.357329] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.357329] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2ca269b5-02b9-467b-bbe8-aeb1d1c90e45 is going to be updated. [ 972.375415] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.375415] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.375415] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.375685] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.375761] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.379861] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.379994] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.380050] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.380238] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.380365] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.380512] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ca269b5-02b9-467b-bbe8-aeb1d1c90e45" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.389242] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 in Status: IN_PROGRESS for 2s [ 972.447107] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fb75cc0b-8db4-4619-bf9e-cad848071f27 [ 972.447107] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.447107] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.447107] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.447107] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.447107] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.447107] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fb75cc0b-8db4-4619-bf9e-cad848071f27 already deleted. [ 972.447107] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb75cc0b-8db4-4619-bf9e-cad848071f27" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.732201] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 03b95f4c-deff-4e4f-be1a-de4b13c8cca7 [ 972.732201] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.732201] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.732201] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.732201] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.732201] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.732201] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:03b95f4c-deff-4e4f-be1a-de4b13c8cca7 already deleted. [ 972.732201] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03b95f4c-deff-4e4f-be1a-de4b13c8cca7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.898875] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 in Status: SUCCESS [ 972.899661] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 deletion is rescheduled due to dependency. [ 972.899888] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.284951] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: SUCCESS [ 973.285337] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.285392] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.286348] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.286348] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.286348] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.286348] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.286348] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.286348] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.286348] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.788448] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.292654] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.403120] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 in Status: SUCCESS [ 974.403361] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.604671] env[69506]: INFO networking_nsxv3.common.synchronization [None req-aa18c411-2137-4c18-aa89-456e2528fde5 None None] Enqueued Resource ID: 81a18ba7-d3af-49df-864c-3ac485d1a182 with Priority: HIGHEST for action port [ 974.605219] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81a18ba7-d3af-49df-864c-3ac485d1a182 with Priority: HIGHEST for action port [ 974.605531] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-81a18ba7-d3af-49df-864c-3ac485d1a182 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.605667] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81a18ba7-d3af-49df-864c-3ac485d1a182" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.605734] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81a18ba7-d3af-49df-864c-3ac485d1a182" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.606009] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81a18ba7-d3af-49df-864c-3ac485d1a182" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.606873] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81a18ba7-d3af-49df-864c-3ac485d1a182',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.797898] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.798088] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.798341] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.798419] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.798493] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.798597] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc is going to be updated. [ 974.827563] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.827747] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.827822] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.828042] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.828237] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.838392] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: IN_PROGRESS for 2s [ 975.109693] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 81a18ba7-d3af-49df-864c-3ac485d1a182 [ 975.109981] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.110143] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.110219] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.110673] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.110673] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.110673] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:81a18ba7-d3af-49df-864c-3ac485d1a182 already deleted. [ 975.110673] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81a18ba7-d3af-49df-864c-3ac485d1a182" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.329034] env[69506]: INFO networking_nsxv3.common.synchronization [req-17f8b108-7702-479d-b3e9-7dc5f2a1b331 req-6d051c09-de0e-4b29-9348-0408aec5d37b tempest-AttachVolumeNegativeTest-402732870 tempest-AttachVolumeNegativeTest-402732870-project-member] Enqueued Resource ID: 23c9b5f8-1cff-4d68-a385-35487b841eb9 with Priority: HIGHEST for action security_group_members [ 976.329321] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23c9b5f8-1cff-4d68-a385-35487b841eb9 with Priority: HIGHEST for action security_group_members [ 976.329436] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-23c9b5f8-1cff-4d68-a385-35487b841eb9 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.330061] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23c9b5f8-1cff-4d68-a385-35487b841eb9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.330061] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23c9b5f8-1cff-4d68-a385-35487b841eb9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.330061] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23c9b5f8-1cff-4d68-a385-35487b841eb9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.331837] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.333744] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.333814] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.334613] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.334613] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.334613] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23c9b5f8-1cff-4d68-a385-35487b841eb9',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.798462] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-477 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.798668] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-477" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.798809] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-477" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.799303] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-477" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.799613] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.799813] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.799948] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.800206] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.800359] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.800575] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 976.800701] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 976.800828] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 976.801011] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 976.801251] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 976.801465] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 976.801905] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 976.819734] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 976.819979] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 976.820233] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 976.820520] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-477" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.820998] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-45f3309c-92ea-4d90-b809-a621b329163e taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.821310] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-45f3309c-92ea-4d90-b809-a621b329163e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.821532] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-45f3309c-92ea-4d90-b809-a621b329163e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.822018] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-45f3309c-92ea-4d90-b809-a621b329163e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.822730] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45f3309c-92ea-4d90-b809-a621b329163e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.837052] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.837728] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.837728] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.837728] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.837728] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.837928] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.837928] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.838036] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.838175] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.838175] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.839263] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23c9b5f8-1cff-4d68-a385-35487b841eb9 already deleted. [ 976.839263] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23c9b5f8-1cff-4d68-a385-35487b841eb9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.849172] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: SUCCESS [ 976.849369] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.850043] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.850225] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.850436] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.850612] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.851280] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.851280] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.851280] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.851280] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.851280] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.324563] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.324794] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.324928] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.325235] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.325394] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.325557] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 45f3309c-92ea-4d90-b809-a621b329163e not found, creating... [ 977.325823] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.325988] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.326123] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.326348] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.326495] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.326781] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.326945] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.327081] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.327370] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.327486] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.327631] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 45f3309c-92ea-4d90-b809-a621b329163e is going to be created. [ 977.349518] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.349891] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.349956] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.350429] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.350633] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.350984] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-45f3309c-92ea-4d90-b809-a621b329163e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.352583] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.352730] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.352825] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.353055] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.353257] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.353384] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.353559] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.353662] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.353769] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.353882] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.354088] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.354214] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.354298] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.354479] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.354661] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.354783] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.354869] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.355057] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.355159] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.355266] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.355383] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.857266] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc: rpc.has_security_group_logging(os_id): False [ 977.874470] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.874650] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.874737] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.874978] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.895023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.895281] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.895405] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.895474] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.895679] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.895795] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.896012] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.896121] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.896182] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.896333] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.896411] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.896588] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.896681] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.896745] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.896888] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.896965] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.897069] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc is going to be updated. [ 977.959355] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.959541] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.959641] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.959898] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.960065] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.975276] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: IN_PROGRESS for 2s [ 978.045581] env[69506]: INFO networking_nsxv3.common.synchronization [req-17f8b108-7702-479d-b3e9-7dc5f2a1b331 req-ad8dfa17-d1c5-4200-8b84-203f43b5f743 service nova] Enqueued Resource ID: 23c9b5f8-1cff-4d68-a385-35487b841eb9 with Priority: HIGHEST for action security_group_rules [ 978.045581] env[69506]: INFO networking_nsxv3.common.synchronization [req-17f8b108-7702-479d-b3e9-7dc5f2a1b331 req-ad8dfa17-d1c5-4200-8b84-203f43b5f743 service nova] Enqueued Resource ID: 23c9b5f8-1cff-4d68-a385-35487b841eb9 with Priority: HIGHEST for action security_group_members [ 978.045581] env[69506]: INFO networking_nsxv3.common.synchronization [req-17f8b108-7702-479d-b3e9-7dc5f2a1b331 req-ad8dfa17-d1c5-4200-8b84-203f43b5f743 service nova] Enqueued Resource ID: 45f3309c-92ea-4d90-b809-a621b329163e with Priority: HIGHEST for action port [ 978.045771] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23c9b5f8-1cff-4d68-a385-35487b841eb9 with Priority: HIGHEST for action security_group_rules [ 978.045870] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23c9b5f8-1cff-4d68-a385-35487b841eb9 with Priority: HIGHEST for action security_group_members [ 978.045960] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45f3309c-92ea-4d90-b809-a621b329163e with Priority: HIGHEST for action port [ 978.046506] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23c9b5f8-1cff-4d68-a385-35487b841eb9 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.046618] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23c9b5f8-1cff-4d68-a385-35487b841eb9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.046684] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23c9b5f8-1cff-4d68-a385-35487b841eb9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.046892] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23c9b5f8-1cff-4d68-a385-35487b841eb9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.046966] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23c9b5f8-1cff-4d68-a385-35487b841eb9',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.048389] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-23c9b5f8-1cff-4d68-a385-35487b841eb9 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.048496] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23c9b5f8-1cff-4d68-a385-35487b841eb9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.048563] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23c9b5f8-1cff-4d68-a385-35487b841eb9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.048741] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23c9b5f8-1cff-4d68-a385-35487b841eb9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.048900] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.048991] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.049065] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.049208] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.049288] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.049375] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23c9b5f8-1cff-4d68-a385-35487b841eb9',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.050262] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-45f3309c-92ea-4d90-b809-a621b329163e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.050262] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45f3309c-92ea-4d90-b809-a621b329163e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.050381] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45f3309c-92ea-4d90-b809-a621b329163e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.050466] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45f3309c-92ea-4d90-b809-a621b329163e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.051128] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45f3309c-92ea-4d90-b809-a621b329163e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.550417] env[69506]: INFO networking_nsxv3.common.synchronization [req-6e637d3e-5d72-4101-8f6d-9692bd12d616 req-6f2f1753-fd36-40ac-b248-80a5af61930e tempest-ListServersNegativeTestJSON-745882135 tempest-ListServersNegativeTestJSON-745882135-project-member] Enqueued Resource ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 with Priority: HIGHEST for action security_group_members [ 978.551326] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 with Priority: HIGHEST for action security_group_members [ 978.551886] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-23c9b5f8-1cff-4d68-a385-35487b841eb9 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.552067] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23c9b5f8-1cff-4d68-a385-35487b841eb9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.552426] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52cf5b6-2860-4667-8ade-9e0529358ed1 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.552552] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.552644] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.552990] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.553227] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.553526] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.553526] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.553682] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.553812] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.553948] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d52cf5b6-2860-4667-8ade-9e0529358ed1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.555217] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('23c9b5f8-1cff-4d68-a385-35487b841eb9',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.556442] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 45f3309c-92ea-4d90-b809-a621b329163e with status ACTIVE [ 978.556674] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.556861] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.556960] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.557211] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.557338] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.557572] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.557714] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.557802] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.558024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.558135] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.558395] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.558535] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.558625] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.558827] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.558935] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.559168] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 45f3309c-92ea-4d90-b809-a621b329163e is going to be updated. [ 978.580854] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.581020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.581099] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.581308] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.581442] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.581604] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45f3309c-92ea-4d90-b809-a621b329163e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.993158] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-268 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.993357] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-268" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.993487] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-268" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.994352] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-268" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.994352] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.994352] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.994511] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.994617] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.994780] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.995001] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 978.995128] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 978.996046] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 978.996046] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 978.996046] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 978.996348] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 978.996670] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 979.014255] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 979.014443] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 979.014561] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 979.014749] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-268" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.015070] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-e957231a-be6f-440e-a753-2c51f68e60ae taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.015531] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-e957231a-be6f-440e-a753-2c51f68e60ae" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.015531] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-e957231a-be6f-440e-a753-2c51f68e60ae" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.015689] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-e957231a-be6f-440e-a753-2c51f68e60ae" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.015847] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e957231a-be6f-440e-a753-2c51f68e60ae',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.056754] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.057009] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.057168] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.057507] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.057540] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.057839] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.057976] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.058090] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.058313] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.058431] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.058611] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 already deleted. [ 979.058611] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.062375] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('23c9b5f8-1cff-4d68-a385-35487b841eb9',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.522195] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.522465] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.522686] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.522901] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.523104] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.523496] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port e957231a-be6f-440e-a753-2c51f68e60ae not found, creating... [ 979.523788] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.523962] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.524105] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.524346] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.524496] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.524798] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.524967] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.526111] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.526362] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.526511] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.526663] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: e957231a-be6f-440e-a753-2c51f68e60ae is going to be created. [ 979.546340] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.549989] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.549989] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.549989] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.549989] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.549989] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-e957231a-be6f-440e-a753-2c51f68e60ae" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.565057] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.565357] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.565357] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.565485] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.565572] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.565669] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23c9b5f8-1cff-4d68-a385-35487b841eb9 is going to be created. [ 979.587859] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.587859] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.587859] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.588158] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.588213] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.598313] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23c9b5f8-1cff-4d68-a385-35487b841eb9 in Status: UNINITIALIZED for 2s [ 979.987909] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: SUCCESS [ 979.988150] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.296152] env[69506]: INFO networking_nsxv3.common.synchronization [req-6e637d3e-5d72-4101-8f6d-9692bd12d616 req-50cd71be-3ffd-4acd-83f5-a73a0f77c14c service nova] Enqueued Resource ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 with Priority: HIGHEST for action security_group_rules [ 980.296380] env[69506]: INFO networking_nsxv3.common.synchronization [req-6e637d3e-5d72-4101-8f6d-9692bd12d616 req-50cd71be-3ffd-4acd-83f5-a73a0f77c14c service nova] Enqueued Resource ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 with Priority: HIGHEST for action security_group_members [ 980.296482] env[69506]: INFO networking_nsxv3.common.synchronization [req-6e637d3e-5d72-4101-8f6d-9692bd12d616 req-50cd71be-3ffd-4acd-83f5-a73a0f77c14c service nova] Enqueued Resource ID: e957231a-be6f-440e-a753-2c51f68e60ae with Priority: HIGHEST for action port [ 980.296723] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 with Priority: HIGHEST for action security_group_rules [ 980.296928] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 with Priority: HIGHEST for action security_group_members [ 980.297120] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e957231a-be6f-440e-a753-2c51f68e60ae with Priority: HIGHEST for action port [ 980.297754] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d52cf5b6-2860-4667-8ade-9e0529358ed1 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.297908] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.297980] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.298285] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.298405] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d52cf5b6-2860-4667-8ade-9e0529358ed1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.299408] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52cf5b6-2860-4667-8ade-9e0529358ed1 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.299546] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.299632] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.299877] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.300059] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.300180] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.300247] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.300391] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.300493] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.300586] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d52cf5b6-2860-4667-8ade-9e0529358ed1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.301407] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-e957231a-be6f-440e-a753-2c51f68e60ae taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.301539] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e957231a-be6f-440e-a753-2c51f68e60ae" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.301777] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e957231a-be6f-440e-a753-2c51f68e60ae" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.301777] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e957231a-be6f-440e-a753-2c51f68e60ae" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.301861] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e957231a-be6f-440e-a753-2c51f68e60ae',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.803866] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d52cf5b6-2860-4667-8ade-9e0529358ed1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.805042] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52cf5b6-2860-4667-8ade-9e0529358ed1 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.805156] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.805527] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e957231a-be6f-440e-a753-2c51f68e60ae with status ACTIVE [ 980.805698] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.808442] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.808589] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.809375] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.813056] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.813056] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.813056] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.813056] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.813056] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.813056] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.813056] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.813729] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.813729] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.813729] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.813729] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.813729] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e957231a-be6f-440e-a753-2c51f68e60ae is going to be updated. [ 980.838268] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.838268] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.838268] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.838268] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.838268] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.838268] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e957231a-be6f-440e-a753-2c51f68e60ae" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.208995] env[69506]: INFO networking_nsxv3.common.synchronization [req-6e637d3e-5d72-4101-8f6d-9692bd12d616 req-0b9f7bda-a974-48ca-b693-cc2594715f65 tempest-ListServersNegativeTestJSON-745882135 tempest-ListServersNegativeTestJSON-745882135-project-member] Enqueued Resource ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 with Priority: HIGHEST for action security_group_members [ 981.209724] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 with Priority: HIGHEST for action security_group_members [ 981.210497] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52cf5b6-2860-4667-8ade-9e0529358ed1 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.211018] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.306915] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d52cf5b6-2860-4667-8ade-9e0529358ed1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.530962] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-268 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.531099] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-268" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.531605] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-268" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.531605] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-268" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.531791] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.531954] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.532182] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.532314] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.532578] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.532692] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 981.532821] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 981.532928] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 981.533053] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 981.533499] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 981.533499] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 981.533499] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 981.552576] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 981.552774] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 981.553265] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 981.553265] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-268" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.553728] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-65cd95ee-43c5-476a-9f4c-e3aef846ec17 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.553728] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-65cd95ee-43c5-476a-9f4c-e3aef846ec17" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.553887] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-65cd95ee-43c5-476a-9f4c-e3aef846ec17" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.554118] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-65cd95ee-43c5-476a-9f4c-e3aef846ec17" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.554267] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65cd95ee-43c5-476a-9f4c-e3aef846ec17',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.611320] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23c9b5f8-1cff-4d68-a385-35487b841eb9 in Status: SUCCESS [ 981.611320] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23c9b5f8-1cff-4d68-a385-35487b841eb9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.611320] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23c9b5f8-1cff-4d68-a385-35487b841eb9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.611320] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23c9b5f8-1cff-4d68-a385-35487b841eb9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.611320] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.611320] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.611320] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.611320] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.611320] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.611320] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23c9b5f8-1cff-4d68-a385-35487b841eb9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.611320] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('23c9b5f8-1cff-4d68-a385-35487b841eb9',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.810880] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.811201] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.811201] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.811518] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.811518] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.811518] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 is going to be created. [ 981.838270] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.838420] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.838806] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.838806] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.838930] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.860099] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 in Status: UNINITIALIZED for 2s [ 982.058878] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.064020] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.064020] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.064020] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.064020] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.064020] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 65cd95ee-43c5-476a-9f4c-e3aef846ec17 not found, creating... [ 982.064020] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.064020] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.064020] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.064020] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.064701] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.066432] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.071041] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.071041] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.071041] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.071041] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.071041] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 65cd95ee-43c5-476a-9f4c-e3aef846ec17 is going to be created. [ 982.092438] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.092438] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.092438] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.092438] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.092438] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.092438] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-65cd95ee-43c5-476a-9f4c-e3aef846ec17" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.113305] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('23c9b5f8-1cff-4d68-a385-35487b841eb9',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.210390] env[69506]: INFO networking_nsxv3.common.synchronization [req-00e3d9b0-4a89-4bbc-aa71-e57639b1d523 req-e8e4adf1-c243-4bc0-a95c-7bcdbdd5212e tempest-ServersTestJSON-1801092994 tempest-ServersTestJSON-1801092994-project-member] Enqueued Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 982.211700] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 982.215068] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.215213] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.215273] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.215497] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.215666] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.215772] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.215837] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.215993] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.216093] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.216190] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.220980] env[69506]: INFO networking_nsxv3.common.synchronization [req-45657e2d-8a5c-4040-a55f-9010767e8f55 req-ea7e43c0-6912-4aa1-91a0-59626fac33a9 tempest-ImagesTestJSON-821230832 tempest-ImagesTestJSON-821230832-project-member] Enqueued Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_members [ 982.221420] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGHEST for action security_group_members [ 982.221802] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d0db323-2ed4-4f6a-a30a-405b16133cb2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.221918] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.221918] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.222128] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.222282] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.222379] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.224324] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.224399] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.224457] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.224558] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.615592] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 23c9b5f8-1cff-4d68-a385-35487b841eb9: rpc.has_security_group_logging(os_id): False [ 982.639618] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.640883] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.640883] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.640883] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.640883] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.640883] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.640883] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.640883] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.641986] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.641986] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.641986] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23c9b5f8-1cff-4d68-a385-35487b841eb9 is going to be created. [ 982.713177] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.713177] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.713177] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.713177] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.713177] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.718951] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.722474] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23c9b5f8-1cff-4d68-a385-35487b841eb9 in Status: IN_PROGRESS for 2s [ 982.726978] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.728168] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.728168] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.728168] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.728168] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.728436] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.728739] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.728739] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.729762] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.729762] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.729762] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 is going to be updated. [ 982.754119] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.754467] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.754467] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.754891] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.754891] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.763851] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: IN_PROGRESS for 2s [ 982.991129] env[69506]: INFO networking_nsxv3.common.synchronization [req-6e637d3e-5d72-4101-8f6d-9692bd12d616 req-20d903fe-f48f-42c8-9103-488eb21b4d34 service nova] Enqueued Resource ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 with Priority: HIGHEST for action security_group_rules [ 982.994519] env[69506]: INFO networking_nsxv3.common.synchronization [req-6e637d3e-5d72-4101-8f6d-9692bd12d616 req-20d903fe-f48f-42c8-9103-488eb21b4d34 service nova] Enqueued Resource ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 with Priority: HIGHEST for action security_group_members [ 982.994519] env[69506]: INFO networking_nsxv3.common.synchronization [req-6e637d3e-5d72-4101-8f6d-9692bd12d616 req-20d903fe-f48f-42c8-9103-488eb21b4d34 service nova] Enqueued Resource ID: 65cd95ee-43c5-476a-9f4c-e3aef846ec17 with Priority: HIGHEST for action port [ 982.994519] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 with Priority: HIGHEST for action security_group_rules [ 982.994519] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 with Priority: HIGHEST for action security_group_members [ 982.994519] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65cd95ee-43c5-476a-9f4c-e3aef846ec17 with Priority: HIGHEST for action port [ 982.994519] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d52cf5b6-2860-4667-8ade-9e0529358ed1 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.994519] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.994519] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52cf5b6-2860-4667-8ade-9e0529358ed1 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.994519] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.994519] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-65cd95ee-43c5-476a-9f4c-e3aef846ec17 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.994519] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65cd95ee-43c5-476a-9f4c-e3aef846ec17" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.994519] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65cd95ee-43c5-476a-9f4c-e3aef846ec17" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.995071] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65cd95ee-43c5-476a-9f4c-e3aef846ec17" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.995071] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65cd95ee-43c5-476a-9f4c-e3aef846ec17',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.224440] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.497088] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 65cd95ee-43c5-476a-9f4c-e3aef846ec17 with status ACTIVE [ 983.497338] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.497477] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.497544] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.497774] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.497903] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.498107] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.498212] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.498276] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.498447] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.498514] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.498691] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.498786] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.498885] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.499059] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.499144] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.499228] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 65cd95ee-43c5-476a-9f4c-e3aef846ec17 is going to be updated. [ 983.528242] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.528242] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.528242] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.528242] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.528242] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.528242] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65cd95ee-43c5-476a-9f4c-e3aef846ec17" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.582142] env[69506]: INFO networking_nsxv3.common.synchronization [req-6e637d3e-5d72-4101-8f6d-9692bd12d616 req-a88e7708-185a-4d08-bfc5-422b21a90714 tempest-ListServersNegativeTestJSON-745882135 tempest-ListServersNegativeTestJSON-745882135-project-member] Enqueued Resource ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 with Priority: HIGHEST for action security_group_members [ 983.582691] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 with Priority: HIGHEST for action security_group_members [ 983.583014] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52cf5b6-2860-4667-8ade-9e0529358ed1 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.583125] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.729017] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.729017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.729017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.729267] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.729267] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.729450] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc is going to be updated. [ 983.758242] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.758449] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.758545] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.759569] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.759569] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.768056] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: IN_PROGRESS for 2s [ 983.863103] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-268 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.863317] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-268" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.863449] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-268" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.863822] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-268" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.864321] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.864594] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.864657] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.864922] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.865115] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.865331] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 983.865463] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 983.865656] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 983.865656] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 983.865841] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 983.865915] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 983.866011] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 983.876936] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 in Status: SUCCESS [ 983.876936] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.876936] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.876936] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.876936] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.878097] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.878316] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.879157] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.879157] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.879332] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.879625] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d52cf5b6-2860-4667-8ade-9e0529358ed1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.882388] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.882388] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.882388] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.882388] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.882388] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.882388] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.882388] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.882825] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d52cf5b6-2860-4667-8ade-9e0529358ed1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.889321] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 983.889493] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 983.889637] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 983.890724] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-268" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.890724] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-235c36fa-73eb-4773-99f5-d15d16c7317e taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.890724] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-235c36fa-73eb-4773-99f5-d15d16c7317e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.890724] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-235c36fa-73eb-4773-99f5-d15d16c7317e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.890724] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-235c36fa-73eb-4773-99f5-d15d16c7317e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.894358] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('235c36fa-73eb-4773-99f5-d15d16c7317e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.389043] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d52cf5b6-2860-4667-8ade-9e0529358ed1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.390149] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52cf5b6-2860-4667-8ade-9e0529358ed1 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.390280] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.393080] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.393296] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.393851] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.393851] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.393967] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.394069] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 235c36fa-73eb-4773-99f5-d15d16c7317e not found, creating... [ 984.394335] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.394495] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.394619] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.394853] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.394997] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.395297] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.395458] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.395578] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.395793] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.396247] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.396247] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 235c36fa-73eb-4773-99f5-d15d16c7317e is going to be created. [ 984.418320] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.418559] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.418717] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.419027] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.419297] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.419572] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-235c36fa-73eb-4773-99f5-d15d16c7317e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.733944] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23c9b5f8-1cff-4d68-a385-35487b841eb9 in Status: SUCCESS [ 984.734220] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23c9b5f8-1cff-4d68-a385-35487b841eb9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.776162] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 in Status: SUCCESS [ 984.776162] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 deletion is rescheduled due to dependency. [ 984.776162] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.890975] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d52cf5b6-2860-4667-8ade-9e0529358ed1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.140045] env[69506]: INFO networking_nsxv3.common.synchronization [req-6e637d3e-5d72-4101-8f6d-9692bd12d616 req-35f33400-d4e0-4158-a405-903e22f8241c service nova] Enqueued Resource ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 with Priority: HIGHEST for action security_group_rules [ 985.140187] env[69506]: INFO networking_nsxv3.common.synchronization [req-6e637d3e-5d72-4101-8f6d-9692bd12d616 req-35f33400-d4e0-4158-a405-903e22f8241c service nova] Enqueued Resource ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 with Priority: HIGHEST for action security_group_members [ 985.140321] env[69506]: INFO networking_nsxv3.common.synchronization [req-6e637d3e-5d72-4101-8f6d-9692bd12d616 req-35f33400-d4e0-4158-a405-903e22f8241c service nova] Enqueued Resource ID: 235c36fa-73eb-4773-99f5-d15d16c7317e with Priority: HIGHEST for action port [ 985.141018] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 with Priority: HIGHEST for action security_group_rules [ 985.141401] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 with Priority: HIGHEST for action security_group_members [ 985.141546] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 235c36fa-73eb-4773-99f5-d15d16c7317e with Priority: HIGHEST for action port [ 985.141820] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d52cf5b6-2860-4667-8ade-9e0529358ed1 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.141930] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.142251] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52cf5b6-2860-4667-8ade-9e0529358ed1 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.142369] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.142565] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-235c36fa-73eb-4773-99f5-d15d16c7317e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.142691] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-235c36fa-73eb-4773-99f5-d15d16c7317e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.142727] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-235c36fa-73eb-4773-99f5-d15d16c7317e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.142935] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-235c36fa-73eb-4773-99f5-d15d16c7317e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.143032] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('235c36fa-73eb-4773-99f5-d15d16c7317e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.393656] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.393983] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.393983] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.394277] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.394417] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.394568] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 is going to be updated. [ 985.424113] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.424260] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.424338] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.424549] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.424694] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.433269] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 in Status: IN_PROGRESS for 2s [ 985.645565] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 235c36fa-73eb-4773-99f5-d15d16c7317e with status ACTIVE [ 985.645792] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.645926] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.645991] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.646288] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.646381] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.646573] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.646674] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.646734] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.647051] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.647051] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.647356] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.647356] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.647356] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.647504] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.647504] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.647587] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 235c36fa-73eb-4773-99f5-d15d16c7317e is going to be updated. [ 985.667160] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.667287] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.667364] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.667605] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.667681] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.667836] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-235c36fa-73eb-4773-99f5-d15d16c7317e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.785170] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: SUCCESS [ 985.785432] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.064301] env[69506]: INFO networking_nsxv3.common.synchronization [req-ccb1be27-2e08-41d6-88ef-1f3d7b4c33fe req-dd76d1b8-3a07-4bb4-b911-3e09cf2f1d8b tempest-ServersTestMultiNic-1599747181 tempest-ServersTestMultiNic-1599747181-project-member] Enqueued Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_members [ 986.064510] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_members [ 986.065805] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbe38da-467a-45a1-9704-6b9d3f78430a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.065805] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.065805] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.065805] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.065805] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.065805] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.065805] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.065805] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.065805] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.065805] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.488636] env[69506]: INFO networking_nsxv3.common.synchronization [req-ccb1be27-2e08-41d6-88ef-1f3d7b4c33fe req-9ceff804-c569-47a5-8603-c29e5dcbb631 tempest-ServersTestMultiNic-1599747181 tempest-ServersTestMultiNic-1599747181-project-member] Enqueued Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_members [ 986.489283] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_members [ 986.489474] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbe38da-467a-45a1-9704-6b9d3f78430a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.489569] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.568704] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.568704] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.568704] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.568704] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.568704] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.568949] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.568949] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.569045] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.569169] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.569227] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.569312] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a already deleted. [ 986.569503] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.569666] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.569856] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.569979] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.570086] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.570144] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.570306] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.570368] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.570436] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.823491] env[69506]: INFO networking_nsxv3.common.synchronization [req-ccb1be27-2e08-41d6-88ef-1f3d7b4c33fe req-fea55db8-0439-4de0-b0ac-ce6b25f3feff tempest-ServersTestMultiNic-1599747181 tempest-ServersTestMultiNic-1599747181-project-member] Enqueued Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_members [ 986.824127] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_members [ 986.824437] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbe38da-467a-45a1-9704-6b9d3f78430a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.824542] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.076264] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.076512] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.076611] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.076936] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.077124] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.077402] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.077537] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.077613] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.077838] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.077941] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.078080] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a already deleted. [ 987.078163] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.078366] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.078561] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.078754] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.078852] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.078907] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.079067] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.079147] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.079258] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.262385] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-25 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.262641] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-25" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.262815] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-25" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.263215] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-25" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.263531] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.263751] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.263891] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.264149] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.264305] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.264523] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 987.264643] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 987.264753] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 987.264864] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 987.264978] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 987.265101] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 987.265245] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 987.287713] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 987.287948] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 987.288169] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 987.288342] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-25" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.288757] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-b71f4913-667d-4447-9df0-2daa9594bae4 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.288983] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-b71f4913-667d-4447-9df0-2daa9594bae4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.289148] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-b71f4913-667d-4447-9df0-2daa9594bae4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.289586] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-b71f4913-667d-4447-9df0-2daa9594bae4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.289783] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b71f4913-667d-4447-9df0-2daa9594bae4',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.444229] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 in Status: SUCCESS [ 987.444453] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.444619] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.444853] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.445049] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.445176] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.445244] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.445399] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.445482] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.445612] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d52cf5b6-2860-4667-8ade-9e0529358ed1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.581648] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.581930] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.581930] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.582145] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.582214] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.582413] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.582520] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.582578] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.582731] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.582810] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.582897] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a already deleted. [ 987.582999] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.794344] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.794344] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.794344] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.794344] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.794344] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.796461] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port b71f4913-667d-4447-9df0-2daa9594bae4 not found, creating... [ 987.796461] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.796461] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.796461] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.796461] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.796461] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.796461] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.796461] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.796461] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.796461] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.796890] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.796890] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: b71f4913-667d-4447-9df0-2daa9594bae4 is going to be created. [ 987.822555] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.822555] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.822555] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.822555] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.822555] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.822555] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-b71f4913-667d-4447-9df0-2daa9594bae4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.948207] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d52cf5b6-2860-4667-8ade-9e0529358ed1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.450406] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d52cf5b6-2860-4667-8ade-9e0529358ed1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.580924] env[69506]: INFO networking_nsxv3.common.synchronization [req-ccb1be27-2e08-41d6-88ef-1f3d7b4c33fe req-23e94c03-77db-4a2f-ab51-23f9f38b8842 service nova] Enqueued Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_rules [ 988.581146] env[69506]: INFO networking_nsxv3.common.synchronization [req-ccb1be27-2e08-41d6-88ef-1f3d7b4c33fe req-23e94c03-77db-4a2f-ab51-23f9f38b8842 service nova] Enqueued Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_members [ 988.581291] env[69506]: INFO networking_nsxv3.common.synchronization [req-ccb1be27-2e08-41d6-88ef-1f3d7b4c33fe req-23e94c03-77db-4a2f-ab51-23f9f38b8842 service nova] Enqueued Resource ID: b71f4913-667d-4447-9df0-2daa9594bae4 with Priority: HIGHEST for action port [ 988.581513] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_rules [ 988.581634] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_members [ 988.581732] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71f4913-667d-4447-9df0-2daa9594bae4 with Priority: HIGHEST for action port [ 988.582292] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2dbe38da-467a-45a1-9704-6b9d3f78430a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.582414] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.582504] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.582724] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.582801] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.583964] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbe38da-467a-45a1-9704-6b9d3f78430a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.584079] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.584146] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.584307] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.584447] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.584536] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.584594] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.584729] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.584807] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.584905] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.585594] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-b71f4913-667d-4447-9df0-2daa9594bae4 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.585689] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b71f4913-667d-4447-9df0-2daa9594bae4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.585768] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b71f4913-667d-4447-9df0-2daa9594bae4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.585928] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b71f4913-667d-4447-9df0-2daa9594bae4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.585991] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b71f4913-667d-4447-9df0-2daa9594bae4',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.957146] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.957302] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.957389] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.957595] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.957689] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.957794] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 is going to be updated. [ 988.984129] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.984263] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.984343] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.984539] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.984682] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.994285] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 in Status: IN_PROGRESS for 2s [ 989.090852] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.091945] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbe38da-467a-45a1-9704-6b9d3f78430a taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.092080] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.092246] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b71f4913-667d-4447-9df0-2daa9594bae4 with status ACTIVE [ 989.092411] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.092517] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.092576] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.092771] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.092860] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.093042] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.093140] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.093211] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.093359] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.093433] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.093613] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.093705] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.093768] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.093904] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.093982] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.094549] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b71f4913-667d-4447-9df0-2daa9594bae4 is going to be updated. [ 989.114252] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.114483] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.114483] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.114656] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.114787] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.114956] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b71f4913-667d-4447-9df0-2daa9594bae4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.338455] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-291 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.338711] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-291" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.338854] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-291" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.339226] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-291" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.339514] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.339689] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.339944] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.340593] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.340772] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.341031] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 989.341166] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 989.341285] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 989.341404] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 989.341539] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 989.341661] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 989.341806] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 989.358909] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 989.359122] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 989.359272] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 989.359446] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-291" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.359742] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-94f8b07c-c655-4378-a772-47a7410934a1 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.359956] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-94f8b07c-c655-4378-a772-47a7410934a1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.360120] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-94f8b07c-c655-4378-a772-47a7410934a1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.360425] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-94f8b07c-c655-4378-a772-47a7410934a1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.360595] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94f8b07c-c655-4378-a772-47a7410934a1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.369550] env[69506]: INFO networking_nsxv3.common.synchronization [req-7a9de346-d8a6-49d3-b31d-9184046c9075 req-c9a8d3fe-5082-4373-ad8e-4125c8cf5240 tempest-AttachInterfacesTestJSON-2055467997 tempest-AttachInterfacesTestJSON-2055467997-project-member] Enqueued Resource ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 with Priority: HIGHEST for action security_group_members [ 989.369812] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 with Priority: HIGHEST for action security_group_members [ 989.370332] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f946d66-543a-40be-9347-81d7eb4f4e31 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.370449] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.370517] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.370694] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.370867] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.370987] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.371619] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.371792] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.371906] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.372011] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.598955] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.735494] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-868 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.735694] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-868" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.735862] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-868" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.736190] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-868" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.736452] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.736620] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.737294] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.737746] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.737746] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.737951] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 989.738088] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 989.738235] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 989.738359] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 989.738537] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 989.738679] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 989.739159] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 989.758179] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 989.758544] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 989.758544] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 989.758758] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-868" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.758918] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-96e2bd64-92c8-47d6-a786-6cdf8834b799 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.759130] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-96e2bd64-92c8-47d6-a786-6cdf8834b799" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.759236] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-96e2bd64-92c8-47d6-a786-6cdf8834b799" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.759562] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-96e2bd64-92c8-47d6-a786-6cdf8834b799" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.759714] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96e2bd64-92c8-47d6-a786-6cdf8834b799',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.863340] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.863630] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.863773] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.864073] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.864234] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.864395] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 94f8b07c-c655-4378-a772-47a7410934a1 not found, creating... [ 989.864682] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.864914] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.865135] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.865379] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.865545] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.865875] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.866058] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.866227] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.866459] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.866615] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.866796] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 94f8b07c-c655-4378-a772-47a7410934a1 is going to be created. [ 989.877420] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.877713] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.877775] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.878433] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.901030] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.901288] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.901422] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.901711] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.901948] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.902300] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-94f8b07c-c655-4378-a772-47a7410934a1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.903690] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.903910] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.904028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.904097] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.904266] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.904347] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.904436] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 is going to be updated. [ 989.942405] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.942663] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.942794] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.943098] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.943292] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.968100] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 in Status: IN_PROGRESS for 2s [ 990.101960] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.102093] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.102379] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.102709] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.102870] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.102953] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a is going to be created. [ 990.133223] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.133400] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.133476] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.133686] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.133853] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.146446] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a in Status: UNINITIALIZED for 2s [ 990.262068] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.262315] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.262446] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.262723] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.262876] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.263103] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 96e2bd64-92c8-47d6-a786-6cdf8834b799 not found, creating... [ 990.263311] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.263558] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.264781] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.264781] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.264781] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.264781] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.264781] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.264781] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.264781] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.265266] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.265266] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 96e2bd64-92c8-47d6-a786-6cdf8834b799 is going to be created. [ 990.284450] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.284737] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.284945] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.285298] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.285615] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.285923] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-96e2bd64-92c8-47d6-a786-6cdf8834b799" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.836770] env[69506]: INFO networking_nsxv3.common.synchronization [req-ccb1be27-2e08-41d6-88ef-1f3d7b4c33fe req-359cf5dd-73d1-44ee-9db1-d632e563725b service nova] Enqueued Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_rules [ 990.836770] env[69506]: INFO networking_nsxv3.common.synchronization [req-ccb1be27-2e08-41d6-88ef-1f3d7b4c33fe req-359cf5dd-73d1-44ee-9db1-d632e563725b service nova] Enqueued Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_members [ 990.836974] env[69506]: INFO networking_nsxv3.common.synchronization [req-ccb1be27-2e08-41d6-88ef-1f3d7b4c33fe req-359cf5dd-73d1-44ee-9db1-d632e563725b service nova] Enqueued Resource ID: 94f8b07c-c655-4378-a772-47a7410934a1 with Priority: HIGHEST for action port [ 990.837372] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_rules [ 990.837510] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_members [ 990.837608] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94f8b07c-c655-4378-a772-47a7410934a1 with Priority: HIGHEST for action port [ 990.837902] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2dbe38da-467a-45a1-9704-6b9d3f78430a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.838024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.838278] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbe38da-467a-45a1-9704-6b9d3f78430a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.838373] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.838583] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-94f8b07c-c655-4378-a772-47a7410934a1 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.840812] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94f8b07c-c655-4378-a772-47a7410934a1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.840812] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94f8b07c-c655-4378-a772-47a7410934a1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.840812] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94f8b07c-c655-4378-a772-47a7410934a1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.840812] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94f8b07c-c655-4378-a772-47a7410934a1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.008332] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 in Status: SUCCESS [ 991.009072] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.009299] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.009532] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.009726] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.009902] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.009968] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.010322] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.010322] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.010322] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d52cf5b6-2860-4667-8ade-9e0529358ed1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.279770] env[69506]: INFO networking_nsxv3.common.synchronization [req-7a9de346-d8a6-49d3-b31d-9184046c9075 req-0c72c910-7900-4f77-8fb0-169d81e84df8 service nova] Enqueued Resource ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 with Priority: HIGHEST for action security_group_rules [ 991.280170] env[69506]: INFO networking_nsxv3.common.synchronization [req-7a9de346-d8a6-49d3-b31d-9184046c9075 req-0c72c910-7900-4f77-8fb0-169d81e84df8 service nova] Enqueued Resource ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 with Priority: HIGHEST for action security_group_members [ 991.280293] env[69506]: INFO networking_nsxv3.common.synchronization [req-7a9de346-d8a6-49d3-b31d-9184046c9075 req-0c72c910-7900-4f77-8fb0-169d81e84df8 service nova] Enqueued Resource ID: 96e2bd64-92c8-47d6-a786-6cdf8834b799 with Priority: HIGHEST for action port [ 991.280760] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 with Priority: HIGHEST for action security_group_rules [ 991.280932] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 with Priority: HIGHEST for action security_group_members [ 991.281308] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96e2bd64-92c8-47d6-a786-6cdf8834b799 with Priority: HIGHEST for action port [ 991.281683] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f946d66-543a-40be-9347-81d7eb4f4e31 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.281873] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.281992] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.282450] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.283109] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.288294] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f946d66-543a-40be-9347-81d7eb4f4e31 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.288294] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.288294] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-96e2bd64-92c8-47d6-a786-6cdf8834b799 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.288294] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96e2bd64-92c8-47d6-a786-6cdf8834b799" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.288294] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96e2bd64-92c8-47d6-a786-6cdf8834b799" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.288294] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96e2bd64-92c8-47d6-a786-6cdf8834b799" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.288294] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96e2bd64-92c8-47d6-a786-6cdf8834b799',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.346030] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 94f8b07c-c655-4378-a772-47a7410934a1 with status ACTIVE [ 991.346030] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.346030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.346030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.346030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.346030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.346030] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.346030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.346030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.346030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.346030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.346030] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.346030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.346030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.346030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.346981] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.346981] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 94f8b07c-c655-4378-a772-47a7410934a1 is going to be updated. [ 991.365804] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.365962] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.366052] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.366242] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.366364] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.366522] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94f8b07c-c655-4378-a772-47a7410934a1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.513209] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d52cf5b6-2860-4667-8ade-9e0529358ed1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.645646] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-25 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.645862] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-25" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.645994] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-25" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.646320] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-25" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.646588] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.646747] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.646866] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.647193] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.647393] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.647657] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 991.647834] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 991.647994] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 991.648149] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 991.648321] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 991.648486] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 991.648661] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 991.668352] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 991.668543] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 991.668689] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 991.668867] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-25" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.669239] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-036b1245-9d63-42d5-ac3a-e2245bef7a3a taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.669422] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-036b1245-9d63-42d5-ac3a-e2245bef7a3a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.669549] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-036b1245-9d63-42d5-ac3a-e2245bef7a3a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.669923] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-036b1245-9d63-42d5-ac3a-e2245bef7a3a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.670088] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('036b1245-9d63-42d5-ac3a-e2245bef7a3a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.792023] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f946d66-543a-40be-9347-81d7eb4f4e31 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.792023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.792023] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 96e2bd64-92c8-47d6-a786-6cdf8834b799 with status ACTIVE [ 991.792023] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.792023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.792023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.792023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.792023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.792023] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.792023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.792023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.792023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.792023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.792573] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.792573] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.792573] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.792573] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.792693] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.793097] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 96e2bd64-92c8-47d6-a786-6cdf8834b799 is going to be updated. [ 991.823169] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.823169] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.823169] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.824700] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.825049] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.825658] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96e2bd64-92c8-47d6-a786-6cdf8834b799" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.981531] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 in Status: SUCCESS [ 991.981764] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 deletion is rescheduled due to dependency. [ 991.981842] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.982024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.982869] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.982869] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.982869] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.982869] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.982869] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.982869] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.983157] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.014277] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d52cf5b6-2860-4667-8ade-9e0529358ed1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.155210] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a in Status: SUCCESS [ 992.155380] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.155873] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.156126] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.156315] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.156427] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.156493] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.156646] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.156725] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.156809] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.156909] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.157768] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.157938] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.158263] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.158371] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.158439] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.158597] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.158676] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.158761] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.172178] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.172365] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.172494] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.172740] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.172887] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.174206] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 036b1245-9d63-42d5-ac3a-e2245bef7a3a not found, creating... [ 992.174206] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.174206] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.174206] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.174206] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.174206] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.174484] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.174484] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.174567] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.174716] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.174896] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.175710] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 036b1245-9d63-42d5-ac3a-e2245bef7a3a is going to be created. [ 992.204501] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.204701] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.204858] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.205151] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.205390] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.205615] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-036b1245-9d63-42d5-ac3a-e2245bef7a3a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.485913] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.517568] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.517831] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.517831] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.518057] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.518142] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.518249] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 is going to be updated. [ 992.546855] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.547049] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.547123] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.547330] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.547471] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.558642] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 in Status: IN_PROGRESS for 2s [ 992.662535] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbe38da-467a-45a1-9704-6b9d3f78430a taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.662682] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.662898] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.987980] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.095672] env[69506]: INFO networking_nsxv3.common.synchronization [req-ccb1be27-2e08-41d6-88ef-1f3d7b4c33fe req-98e6411b-d1fe-4e6c-a82e-e143c985092f service nova] Enqueued Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_rules [ 993.095981] env[69506]: INFO networking_nsxv3.common.synchronization [req-ccb1be27-2e08-41d6-88ef-1f3d7b4c33fe req-98e6411b-d1fe-4e6c-a82e-e143c985092f service nova] Enqueued Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_members [ 993.099043] env[69506]: INFO networking_nsxv3.common.synchronization [req-ccb1be27-2e08-41d6-88ef-1f3d7b4c33fe req-98e6411b-d1fe-4e6c-a82e-e143c985092f service nova] Enqueued Resource ID: 036b1245-9d63-42d5-ac3a-e2245bef7a3a with Priority: HIGHEST for action port [ 993.099989] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_rules [ 993.103535] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_members [ 993.103535] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 036b1245-9d63-42d5-ac3a-e2245bef7a3a with Priority: HIGHEST for action port [ 993.103535] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2dbe38da-467a-45a1-9704-6b9d3f78430a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.103535] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.103535] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbe38da-467a-45a1-9704-6b9d3f78430a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.103535] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.103535] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-036b1245-9d63-42d5-ac3a-e2245bef7a3a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.103535] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-036b1245-9d63-42d5-ac3a-e2245bef7a3a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.103535] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-036b1245-9d63-42d5-ac3a-e2245bef7a3a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.103535] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-036b1245-9d63-42d5-ac3a-e2245bef7a3a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.103535] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('036b1245-9d63-42d5-ac3a-e2245bef7a3a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.126885] env[69506]: INFO networking_nsxv3.common.synchronization [req-07bd3426-eaac-4982-a7da-7caa076340e9 req-cd9d10f6-fa69-4dd2-9934-e59db8e542b5 tempest-ServersV294TestFqdnHostnames-1239405206 tempest-ServersV294TestFqdnHostnames-1239405206-project-member] Enqueued Resource ID: cb920054-1c0f-4a74-aad1-8ca7ce036993 with Priority: HIGHEST for action security_group_members [ 993.127504] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb920054-1c0f-4a74-aad1-8ca7ce036993 with Priority: HIGHEST for action security_group_members [ 993.127895] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb920054-1c0f-4a74-aad1-8ca7ce036993 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.128623] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb920054-1c0f-4a74-aad1-8ca7ce036993" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.128754] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb920054-1c0f-4a74-aad1-8ca7ce036993" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.129026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb920054-1c0f-4a74-aad1-8ca7ce036993" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.129247] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.129381] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.129466] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.129659] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.129768] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.129900] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb920054-1c0f-4a74-aad1-8ca7ce036993',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.165375] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.368021] env[69506]: INFO networking_nsxv3.common.synchronization [None req-eac524d2-0d9d-48b7-af3e-361baeb4c887 None None] Enqueued Resource ID: c5ae8cdc-e0ec-483d-b60c-56036b4425e6 with Priority: HIGHEST for action port [ 993.368021] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5ae8cdc-e0ec-483d-b60c-56036b4425e6 with Priority: HIGHEST for action port [ 993.368021] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5ae8cdc-e0ec-483d-b60c-56036b4425e6 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.368021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5ae8cdc-e0ec-483d-b60c-56036b4425e6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.368021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5ae8cdc-e0ec-483d-b60c-56036b4425e6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.368021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5ae8cdc-e0ec-483d-b60c-56036b4425e6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.368021] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5ae8cdc-e0ec-483d-b60c-56036b4425e6',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.491916] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.491916] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.491916] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.491916] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.491916] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.491916] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 is going to be updated. [ 993.522729] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.522883] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.522944] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.523246] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.523326] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.532147] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 in Status: IN_PROGRESS for 2s [ 993.609337] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 036b1245-9d63-42d5-ac3a-e2245bef7a3a with status ACTIVE [ 993.609337] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.609337] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.609337] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.609337] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.609337] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.609750] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.609750] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.609970] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.610638] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.610638] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.610638] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.610638] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.610638] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.611061] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.611061] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.611977] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 036b1245-9d63-42d5-ac3a-e2245bef7a3a is going to be updated. [ 993.635792] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.636020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.636020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.636224] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.636360] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.636523] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-036b1245-9d63-42d5-ac3a-e2245bef7a3a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.636849] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.636977] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.637062] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.637231] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.665911] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.666200] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.666402] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.666602] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.666817] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.666908] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.667013] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb920054-1c0f-4a74-aad1-8ca7ce036993 is going to be updated. [ 993.669065] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.669202] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.669240] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.669390] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.669470] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.669558] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a is going to be updated. [ 993.700519] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.700702] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.700777] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.701055] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.701201] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.702967] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.703097] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.703153] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.703454] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.703454] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.720241] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a in Status: IN_PROGRESS for 2s [ 993.721235] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb920054-1c0f-4a74-aad1-8ca7ce036993 in Status: IN_PROGRESS for 2s [ 993.876064] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c5ae8cdc-e0ec-483d-b60c-56036b4425e6 [ 993.876346] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.876489] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.876558] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.876765] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.876863] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.876962] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c5ae8cdc-e0ec-483d-b60c-56036b4425e6 already deleted. [ 993.877056] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5ae8cdc-e0ec-483d-b60c-56036b4425e6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.017341] env[69506]: INFO networking_nsxv3.common.synchronization [req-898bdf41-5f71-416d-8187-3fd4affd3bdc req-133dd84d-5257-4f8b-bf23-f84048520c7b tempest-ServerDiskConfigTestJSON-583020681 tempest-ServerDiskConfigTestJSON-583020681-project-member] Enqueued Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_members [ 994.017994] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_members [ 994.017994] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-008501d4-938b-4336-9c1d-ef3665f7d09d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.019195] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.019270] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.019464] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.019623] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.019877] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.019877] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.019985] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.020091] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.020181] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.525228] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.525228] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.525228] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.525228] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.545203] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.545203] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.545318] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.545356] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.545539] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.545618] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.545705] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 008501d4-938b-4336-9c1d-ef3665f7d09d is going to be updated. [ 994.569777] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 in Status: SUCCESS [ 994.569777] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.569777] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.569777] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.569777] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.569777] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.569777] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.569777] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.569777] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.569777] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.569777] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52cf5b6-2860-4667-8ade-9e0529358ed1 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.569777] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.569777] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.569777] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.569777] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.572229] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.572229] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.572229] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.572229] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.572229] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.572229] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d52cf5b6-2860-4667-8ade-9e0529358ed1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.574474] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.574628] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.574695] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.574899] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.576073] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.577185] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.580167] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.580384] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.580547] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.580635] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.580849] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.580980] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.581119] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d52cf5b6-2860-4667-8ade-9e0529358ed1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.589275] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 008501d4-938b-4336-9c1d-ef3665f7d09d in Status: IN_PROGRESS for 2s [ 994.985412] env[69506]: INFO networking_nsxv3.common.synchronization [req-ddd193a4-b788-4b62-b568-23c03131af99 req-509dce41-b855-40d6-a665-1c443467ec9c tempest-ServerMetadataTestJSON-1686448456 tempest-ServerMetadataTestJSON-1686448456-project-member] Enqueued Resource ID: d8ff5e5b-5797-4254-b957-602d11e125dd with Priority: HIGHEST for action security_group_members [ 994.985924] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8ff5e5b-5797-4254-b957-602d11e125dd with Priority: HIGHEST for action security_group_members [ 994.986231] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8ff5e5b-5797-4254-b957-602d11e125dd taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.986352] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8ff5e5b-5797-4254-b957-602d11e125dd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.986420] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8ff5e5b-5797-4254-b957-602d11e125dd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.986662] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8ff5e5b-5797-4254-b957-602d11e125dd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.986821] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.987051] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.987051] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.990276] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.990276] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.990276] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8ff5e5b-5797-4254-b957-602d11e125dd',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.085452] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d52cf5b6-2860-4667-8ade-9e0529358ed1: rpc.has_security_group_logging(os_id): False [ 995.085452] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d52cf5b6-2860-4667-8ade-9e0529358ed1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.112019] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.112019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.112019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.112019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.112019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.112019] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.112019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.112019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.112019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.112019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.112019] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.112019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.112019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.112019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.112019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.112718] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.112718] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.112718] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.112718] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.112718] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.112718] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 is going to be created. [ 995.207925] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.207925] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.207925] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.207925] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.207925] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.220688] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 in Status: IN_PROGRESS for 2s [ 995.322075] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-927 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.322305] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-927" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.322853] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-927" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.322853] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-927" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.323178] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.323388] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.323526] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.324700] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.324700] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.324700] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 995.324700] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 995.324700] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 995.324700] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 995.324700] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 995.324700] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 995.325191] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 995.348921] env[69506]: INFO networking_nsxv3.common.synchronization [None req-678f433a-0d8a-4004-b5f6-476fd9acf5a8 tempest-ImagesOneServerNegativeTestJSON-1660335094 tempest-ImagesOneServerNegativeTestJSON-1660335094-project-member] Enqueued Resource ID: 985b05a5-6290-4906-8ad8-70ce549c7726 with Priority: HIGHEST for action security_group_rules [ 995.349519] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 985b05a5-6290-4906-8ad8-70ce549c7726 with Priority: HIGHEST for action security_group_rules [ 995.350652] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-985b05a5-6290-4906-8ad8-70ce549c7726 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.350652] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-985b05a5-6290-4906-8ad8-70ce549c7726" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.350652] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-985b05a5-6290-4906-8ad8-70ce549c7726" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.350652] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-985b05a5-6290-4906-8ad8-70ce549c7726" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.350652] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('985b05a5-6290-4906-8ad8-70ce549c7726',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.353640] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 995.353810] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 995.353956] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 995.354169] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-927" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.354681] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-bf1dc8a4-095d-4391-8c2f-7b2a7c9545ca taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.354681] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-bf1dc8a4-095d-4391-8c2f-7b2a7c9545ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.354831] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-bf1dc8a4-095d-4391-8c2f-7b2a7c9545ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.355116] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-bf1dc8a4-095d-4391-8c2f-7b2a7c9545ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.355688] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf1dc8a4-095d-4391-8c2f-7b2a7c9545ca',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.428537] env[69506]: INFO networking_nsxv3.common.synchronization [None req-bd88190b-f585-47ec-a94c-75b7dd561bfd tempest-ImagesOneServerNegativeTestJSON-1660335094 tempest-ImagesOneServerNegativeTestJSON-1660335094-project-member] Enqueued Resource ID: 985b05a5-6290-4906-8ad8-70ce549c7726 with Priority: HIGHEST for action security_group_rules [ 995.428784] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 985b05a5-6290-4906-8ad8-70ce549c7726 with Priority: HIGHEST for action security_group_rules [ 995.429095] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-985b05a5-6290-4906-8ad8-70ce549c7726 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.429206] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-985b05a5-6290-4906-8ad8-70ce549c7726" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.491931] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.492176] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.492176] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.492651] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.492651] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.492757] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.492839] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.492929] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.493132] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.493229] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.493353] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8ff5e5b-5797-4254-b957-602d11e125dd already deleted. [ 995.493460] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8ff5e5b-5797-4254-b957-602d11e125dd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.542757] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 in Status: SUCCESS [ 995.543485] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.543625] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.544024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.544093] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.544186] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.544254] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.544426] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.544511] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.544599] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.544694] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.592143] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d52cf5b6-2860-4667-8ade-9e0529358ed1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.695618] env[69506]: INFO networking_nsxv3.common.synchronization [None req-f2b2ab40-8e6d-4a62-bef6-02a5251ae555 None None] Enqueued Resource ID: 8dc8ff24-f8fd-4542-ae91-d6d29d989c43 with Priority: HIGHEST for action port [ 995.696094] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8dc8ff24-f8fd-4542-ae91-d6d29d989c43 with Priority: HIGHEST for action port [ 995.696461] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-8dc8ff24-f8fd-4542-ae91-d6d29d989c43 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.696610] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8dc8ff24-f8fd-4542-ae91-d6d29d989c43" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.696851] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8dc8ff24-f8fd-4542-ae91-d6d29d989c43" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.697387] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8dc8ff24-f8fd-4542-ae91-d6d29d989c43" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.697387] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dc8ff24-f8fd-4542-ae91-d6d29d989c43',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.736790] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a in Status: SUCCESS [ 995.736790] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.736790] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.736790] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.736790] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.737517] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.738249] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.739677] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.739677] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.742092] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.742092] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbe38da-467a-45a1-9704-6b9d3f78430a taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.742092] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.742092] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.742092] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.742092] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.742092] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.742092] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.742092] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.742092] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.742092] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.742092] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.744637] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb920054-1c0f-4a74-aad1-8ca7ce036993 in Status: SUCCESS [ 995.745711] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb920054-1c0f-4a74-aad1-8ca7ce036993 deletion is rescheduled due to dependency. [ 995.745711] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb920054-1c0f-4a74-aad1-8ca7ce036993" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.745711] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.745711] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.745711] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.746036] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.746036] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.746036] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.747061] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.747206] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.860801] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.861520] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.861787] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.862206] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.862429] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.862653] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port bf1dc8a4-095d-4391-8c2f-7b2a7c9545ca not found, creating... [ 995.863074] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.863331] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.863613] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.864731] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.865221] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.866135] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.866443] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.866664] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.867034] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.867288] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.867545] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: bf1dc8a4-095d-4391-8c2f-7b2a7c9545ca is going to be created. [ 995.878631] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.878828] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.878863] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.879216] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.879294] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.879400] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 985b05a5-6290-4906-8ad8-70ce549c7726 already deleted. [ 995.879485] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-985b05a5-6290-4906-8ad8-70ce549c7726" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.879911] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-985b05a5-6290-4906-8ad8-70ce549c7726" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.879911] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-985b05a5-6290-4906-8ad8-70ce549c7726" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.879911] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('985b05a5-6290-4906-8ad8-70ce549c7726',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.885716] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.885932] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.886075] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.886341] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.886571] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.886842] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-bf1dc8a4-095d-4391-8c2f-7b2a7c9545ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.048020] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f946d66-543a-40be-9347-81d7eb4f4e31 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.048245] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.048334] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.048557] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.048733] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.048855] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.048930] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.049074] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.049163] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.049251] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.049399] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f946d66-543a-40be-9347-81d7eb4f4e31 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.049491] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.049574] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.049767] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.049947] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.050060] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.050124] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.050266] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.050343] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.050425] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.050515] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.094225] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.094225] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.094225] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.094574] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.094574] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.094650] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 is going to be updated. [ 996.121803] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.121803] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.121803] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.121964] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.122405] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.132402] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 in Status: IN_PROGRESS for 2s [ 996.200052] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8dc8ff24-f8fd-4542-ae91-d6d29d989c43 [ 996.200551] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.201708] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.201708] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.201708] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.201708] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.201708] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8dc8ff24-f8fd-4542-ae91-d6d29d989c43 already deleted. [ 996.201708] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8dc8ff24-f8fd-4542-ae91-d6d29d989c43" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.249800] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2dbe38da-467a-45a1-9704-6b9d3f78430a: rpc.has_security_group_logging(os_id): False [ 996.252398] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.267111] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.267301] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.267301] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.267512] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.267601] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.267842] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.267937] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.267995] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.268144] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.268216] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.268394] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.268479] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.268534] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.268672] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.268744] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.268918] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.269012] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.269072] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.269208] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.269281] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.269364] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a is going to be created. [ 996.325216] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.325433] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.325512] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.325737] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.325915] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.335063] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a in Status: IN_PROGRESS for 2s [ 996.402820] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.402984] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.403114] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.403341] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.403434] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.403532] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 985b05a5-6290-4906-8ad8-70ce549c7726 already deleted. [ 996.403619] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-985b05a5-6290-4906-8ad8-70ce549c7726" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.552337] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3f946d66-543a-40be-9347-81d7eb4f4e31: rpc.has_security_group_logging(os_id): False [ 996.574778] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.575338] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.575338] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.575338] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.575338] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.575625] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.575793] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.575994] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.576158] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.576398] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.576483] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.576905] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.576905] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.576905] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.576905] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.578916] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.579039] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.579039] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.579381] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.579381] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.579381] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 is going to be updated. [ 996.598085] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 008501d4-938b-4336-9c1d-ef3665f7d09d in Status: SUCCESS [ 996.599994] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 008501d4-938b-4336-9c1d-ef3665f7d09d deletion is rescheduled due to dependency. [ 996.599994] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.672408] env[69506]: INFO networking_nsxv3.common.synchronization [req-ddd193a4-b788-4b62-b568-23c03131af99 req-9ce75e82-4dbb-46be-b1bb-dd9309365165 service nova] Enqueued Resource ID: d8ff5e5b-5797-4254-b957-602d11e125dd with Priority: HIGHEST for action security_group_rules [ 996.672408] env[69506]: INFO networking_nsxv3.common.synchronization [req-ddd193a4-b788-4b62-b568-23c03131af99 req-9ce75e82-4dbb-46be-b1bb-dd9309365165 service nova] Enqueued Resource ID: d8ff5e5b-5797-4254-b957-602d11e125dd with Priority: HIGHEST for action security_group_members [ 996.672408] env[69506]: INFO networking_nsxv3.common.synchronization [req-ddd193a4-b788-4b62-b568-23c03131af99 req-9ce75e82-4dbb-46be-b1bb-dd9309365165 service nova] Enqueued Resource ID: bf1dc8a4-095d-4391-8c2f-7b2a7c9545ca with Priority: HIGHEST for action port [ 996.672408] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8ff5e5b-5797-4254-b957-602d11e125dd with Priority: HIGHEST for action security_group_rules [ 996.672408] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8ff5e5b-5797-4254-b957-602d11e125dd with Priority: HIGHEST for action security_group_members [ 996.672408] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf1dc8a4-095d-4391-8c2f-7b2a7c9545ca with Priority: HIGHEST for action port [ 996.672408] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8ff5e5b-5797-4254-b957-602d11e125dd taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.680028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8ff5e5b-5797-4254-b957-602d11e125dd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.680028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8ff5e5b-5797-4254-b957-602d11e125dd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.680028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8ff5e5b-5797-4254-b957-602d11e125dd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.680028] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8ff5e5b-5797-4254-b957-602d11e125dd',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.680028] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8ff5e5b-5797-4254-b957-602d11e125dd taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.680028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8ff5e5b-5797-4254-b957-602d11e125dd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.680028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8ff5e5b-5797-4254-b957-602d11e125dd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.680028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8ff5e5b-5797-4254-b957-602d11e125dd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.680028] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.680028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.680028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.680028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.680028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.680028] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8ff5e5b-5797-4254-b957-602d11e125dd',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.682056] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf1dc8a4-095d-4391-8c2f-7b2a7c9545ca taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.682334] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf1dc8a4-095d-4391-8c2f-7b2a7c9545ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.682506] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf1dc8a4-095d-4391-8c2f-7b2a7c9545ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.683060] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf1dc8a4-095d-4391-8c2f-7b2a7c9545ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.683252] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf1dc8a4-095d-4391-8c2f-7b2a7c9545ca',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.685651] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.685943] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.686134] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.686395] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.686634] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.704159] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 in Status: IN_PROGRESS for 2s [ 996.754423] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.185468] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8ff5e5b-5797-4254-b957-602d11e125dd',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.192159] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8ff5e5b-5797-4254-b957-602d11e125dd taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.192299] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8ff5e5b-5797-4254-b957-602d11e125dd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.192487] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf1dc8a4-095d-4391-8c2f-7b2a7c9545ca with status ACTIVE [ 997.192649] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.192749] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.192855] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.193113] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.193206] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.193381] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.193478] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.193526] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.193675] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.193748] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.193922] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.194031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.194078] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.194213] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.194282] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.194363] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf1dc8a4-095d-4391-8c2f-7b2a7c9545ca is going to be updated. [ 997.216427] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.216427] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.216427] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.216427] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.216427] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.216427] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf1dc8a4-095d-4391-8c2f-7b2a7c9545ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.232823] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 in Status: SUCCESS [ 997.232823] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.233301] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.233552] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.233641] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d52cf5b6-2860-4667-8ade-9e0529358ed1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.258023] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.258023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.258023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.258970] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.258970] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.258970] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a is going to be updated. [ 997.291361] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.291361] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.291361] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.291621] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.291678] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.304264] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a in Status: IN_PROGRESS for 2s [ 997.391960] env[69506]: INFO networking_nsxv3.common.synchronization [req-50eaf4f8-18fa-48a8-b5b6-ef82d5248031 req-0920ab0f-85cc-4461-a5c5-f5892f12414a tempest-ServerAddressesNegativeTestJSON-632973573 tempest-ServerAddressesNegativeTestJSON-632973573-project-member] Enqueued Resource ID: f7dad645-1b67-495c-8fe3-ab50c7737c6c with Priority: HIGHEST for action security_group_members [ 997.393605] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7dad645-1b67-495c-8fe3-ab50c7737c6c with Priority: HIGHEST for action security_group_members [ 997.394043] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7dad645-1b67-495c-8fe3-ab50c7737c6c taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.394305] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7dad645-1b67-495c-8fe3-ab50c7737c6c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.394461] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7dad645-1b67-495c-8fe3-ab50c7737c6c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.394775] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7dad645-1b67-495c-8fe3-ab50c7737c6c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.395246] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.395835] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.396288] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.397424] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.397424] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.397424] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7dad645-1b67-495c-8fe3-ab50c7737c6c',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.692024] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8ff5e5b-5797-4254-b957-602d11e125dd',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.738268] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52cf5b6-2860-4667-8ade-9e0529358ed1 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.738377] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.765056] env[69506]: INFO networking_nsxv3.common.synchronization [None req-20b567ac-1d9c-4bea-9f0f-cbeeebafc311 tempest-AttachInterfacesTestJSON-2055467997 tempest-AttachInterfacesTestJSON-2055467997-project-member] Enqueued Resource ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 with Priority: HIGHEST for action security_group_members [ 997.766170] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 with Priority: HIGHEST for action security_group_members [ 997.767370] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f946d66-543a-40be-9347-81d7eb4f4e31 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.767544] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.767653] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.767912] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.768151] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.768266] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.768335] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.768530] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.768624] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.768750] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.815796] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-749 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.816059] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-749" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.816226] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-749" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.816556] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-749" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.816835] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.817011] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.817149] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.817378] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.817548] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.818515] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 997.818515] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 997.818515] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 997.818515] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 997.818515] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 997.818515] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 997.818515] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 997.836803] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 997.840223] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 997.840223] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 997.840223] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-749" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.840223] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-70f1cbcc-bee9-4511-b793-2fce38f761aa taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.840223] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-70f1cbcc-bee9-4511-b793-2fce38f761aa" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.840223] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-70f1cbcc-bee9-4511-b793-2fce38f761aa" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.840223] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-70f1cbcc-bee9-4511-b793-2fce38f761aa" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.840223] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70f1cbcc-bee9-4511-b793-2fce38f761aa',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.899641] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.899827] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.899921] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.900160] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.900266] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.900477] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.900580] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.900645] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.900807] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.900887] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.900975] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7dad645-1b67-495c-8fe3-ab50c7737c6c already deleted. [ 997.901074] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7dad645-1b67-495c-8fe3-ab50c7737c6c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.140285] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 in Status: SUCCESS [ 998.140510] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.140674] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.140917] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.141125] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.141242] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.141308] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.141456] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.141538] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.141622] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.141713] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d52cf5b6-2860-4667-8ade-9e0529358ed1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.197838] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.197838] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.197838] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.197838] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.197838] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.197838] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8ff5e5b-5797-4254-b957-602d11e125dd is going to be created. [ 998.223624] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.223802] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.223873] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.224156] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.224351] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.233419] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8ff5e5b-5797-4254-b957-602d11e125dd in Status: UNINITIALIZED for 2s [ 998.271854] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.342535] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.342871] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.342952] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.343195] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.344049] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.344049] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 70f1cbcc-bee9-4511-b793-2fce38f761aa not found, creating... [ 998.344049] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.344049] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.344049] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.344334] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.344452] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.344670] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.344831] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.344955] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.345190] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.345330] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.345475] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 70f1cbcc-bee9-4511-b793-2fce38f761aa is going to be created. [ 998.354384] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a in Status: SUCCESS [ 998.355038] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.355038] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.355038] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.355038] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.370379] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.370595] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.370745] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.371010] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.371261] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.371488] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-70f1cbcc-bee9-4511-b793-2fce38f761aa" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.644738] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52cf5b6-2860-4667-8ade-9e0529358ed1 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.644904] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.644978] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.645212] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.645402] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.645508] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.645568] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.645724] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.645812] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.645905] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.646093] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52cf5b6-2860-4667-8ade-9e0529358ed1 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.646201] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.646265] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.646403] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.646539] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.646630] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.646689] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.646820] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.646899] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.646981] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.647084] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d52cf5b6-2860-4667-8ade-9e0529358ed1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.720402] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 in Status: SUCCESS [ 998.720648] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.774174] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.857161] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbe38da-467a-45a1-9704-6b9d3f78430a taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.857292] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.076413] env[69506]: INFO networking_nsxv3.common.synchronization [req-50eaf4f8-18fa-48a8-b5b6-ef82d5248031 req-5672e447-305f-4065-8aa9-4b3e6e2eae3f service nova] Enqueued Resource ID: f7dad645-1b67-495c-8fe3-ab50c7737c6c with Priority: HIGHEST for action security_group_rules [ 999.076546] env[69506]: INFO networking_nsxv3.common.synchronization [req-50eaf4f8-18fa-48a8-b5b6-ef82d5248031 req-5672e447-305f-4065-8aa9-4b3e6e2eae3f service nova] Enqueued Resource ID: f7dad645-1b67-495c-8fe3-ab50c7737c6c with Priority: HIGHEST for action security_group_members [ 999.076817] env[69506]: INFO networking_nsxv3.common.synchronization [req-50eaf4f8-18fa-48a8-b5b6-ef82d5248031 req-5672e447-305f-4065-8aa9-4b3e6e2eae3f service nova] Enqueued Resource ID: 70f1cbcc-bee9-4511-b793-2fce38f761aa with Priority: HIGHEST for action port [ 999.082436] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7dad645-1b67-495c-8fe3-ab50c7737c6c with Priority: HIGHEST for action security_group_rules [ 999.082668] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7dad645-1b67-495c-8fe3-ab50c7737c6c with Priority: HIGHEST for action security_group_members [ 999.082824] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70f1cbcc-bee9-4511-b793-2fce38f761aa with Priority: HIGHEST for action port [ 999.083176] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7dad645-1b67-495c-8fe3-ab50c7737c6c taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.083309] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7dad645-1b67-495c-8fe3-ab50c7737c6c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.083378] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7dad645-1b67-495c-8fe3-ab50c7737c6c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.083660] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7dad645-1b67-495c-8fe3-ab50c7737c6c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.083734] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7dad645-1b67-495c-8fe3-ab50c7737c6c',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.084655] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7dad645-1b67-495c-8fe3-ab50c7737c6c taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.084776] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7dad645-1b67-495c-8fe3-ab50c7737c6c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.084846] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7dad645-1b67-495c-8fe3-ab50c7737c6c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.085486] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7dad645-1b67-495c-8fe3-ab50c7737c6c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.086642] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.088355] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.088355] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.088355] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.088355] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.088355] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7dad645-1b67-495c-8fe3-ab50c7737c6c',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.088655] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-70f1cbcc-bee9-4511-b793-2fce38f761aa taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.088721] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70f1cbcc-bee9-4511-b793-2fce38f761aa" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.088840] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70f1cbcc-bee9-4511-b793-2fce38f761aa" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.088982] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70f1cbcc-bee9-4511-b793-2fce38f761aa" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.089054] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70f1cbcc-bee9-4511-b793-2fce38f761aa',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.152112] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d52cf5b6-2860-4667-8ade-9e0529358ed1: rpc.has_security_group_logging(os_id): False [ 999.170129] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.170129] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.170129] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.170428] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.170473] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.170638] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.170721] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.170811] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.170955] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.171043] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.171287] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.171495] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.171495] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.171638] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.171638] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.174314] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.174314] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.174411] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.174825] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.174825] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.174825] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 is going to be updated. [ 999.258873] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.259251] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.259372] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.259561] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.259719] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.273278] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 in Status: IN_PROGRESS for 2s [ 999.278868] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.279012] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.279102] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.279328] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.279430] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.279529] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 is going to be updated. [ 999.312142] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.312373] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.312417] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.312659] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.312842] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.314600] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a in Status: SUCCESS [ 999.314825] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.315412] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.315544] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.315755] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.315907] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.316012] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.316181] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.316265] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.316351] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.316439] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.322043] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 in Status: IN_PROGRESS for 2s [ 999.591681] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7dad645-1b67-495c-8fe3-ab50c7737c6c',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.592780] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7dad645-1b67-495c-8fe3-ab50c7737c6c taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.592780] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7dad645-1b67-495c-8fe3-ab50c7737c6c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.594086] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 70f1cbcc-bee9-4511-b793-2fce38f761aa with status ACTIVE [ 999.594086] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.594086] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.594086] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.594373] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.594373] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.594696] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.594696] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.594696] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.594809] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.594843] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.595015] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.595618] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.595618] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.595618] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.595618] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.595618] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 70f1cbcc-bee9-4511-b793-2fce38f761aa is going to be updated. [ 999.626621] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.626827] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.626938] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.630135] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.630135] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.630135] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70f1cbcc-bee9-4511-b793-2fce38f761aa" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.820077] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbe38da-467a-45a1-9704-6b9d3f78430a taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.820251] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.820322] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.820626] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.820709] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.820810] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.820907] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.822656] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.822656] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.822656] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.822656] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbe38da-467a-45a1-9704-6b9d3f78430a taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.822656] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.822656] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.822656] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.822656] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.822656] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.822656] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.822656] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.822656] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.822656] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.822656] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.980676] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-868 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.982610] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-868" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.982775] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-868" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.985353] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-868" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.985677] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.985784] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.985917] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.986203] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.986361] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.986702] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 999.986702] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 999.986843] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 999.987013] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 999.987158] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 999.987276] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 999.988048] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1000.007093] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1000.007875] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1000.007875] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1000.007875] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-868" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.008162] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-5e732b1d-3f2b-4011-9f60-5340f5cf8ac5 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.008347] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-5e732b1d-3f2b-4011-9f60-5340f5cf8ac5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.008478] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-5e732b1d-3f2b-4011-9f60-5340f5cf8ac5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.008803] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-5e732b1d-3f2b-4011-9f60-5340f5cf8ac5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.008955] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e732b1d-3f2b-4011-9f60-5340f5cf8ac5',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.082419] env[69506]: INFO networking_nsxv3.common.synchronization [req-5c06054b-5a8e-41f3-a5d5-22d52b9b2b94 req-68574bc7-bd57-437f-990b-1502da484ff3 tempest-ListServersNegativeTestJSON-745882135 tempest-ListServersNegativeTestJSON-745882135-project-member] Enqueued Resource ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 with Priority: HIGHEST for action security_group_members [ 1000.082913] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 with Priority: HIGHEST for action security_group_members [ 1000.083251] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52cf5b6-2860-4667-8ade-9e0529358ed1 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.083379] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.083446] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.083634] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.083785] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.083880] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.083944] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.085607] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.085712] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.085813] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d52cf5b6-2860-4667-8ade-9e0529358ed1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.093854] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7dad645-1b67-495c-8fe3-ab50c7737c6c',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.243238] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8ff5e5b-5797-4254-b957-602d11e125dd in Status: SUCCESS [ 1000.244241] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8ff5e5b-5797-4254-b957-602d11e125dd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.244512] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8ff5e5b-5797-4254-b957-602d11e125dd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.245150] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8ff5e5b-5797-4254-b957-602d11e125dd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.247409] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.247409] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.247409] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.247409] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.247409] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.247409] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8ff5e5b-5797-4254-b957-602d11e125dd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.247409] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8ff5e5b-5797-4254-b957-602d11e125dd',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.326554] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2dbe38da-467a-45a1-9704-6b9d3f78430a: rpc.has_security_group_logging(os_id): False [ 1000.344152] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.344858] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.344858] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.344858] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.344858] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.345065] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.345065] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.345065] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.345311] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.345311] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.345467] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.345561] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.345640] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.345755] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.345822] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.346035] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.346162] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.346162] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.346291] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.346359] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.346439] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a is going to be updated. [ 1000.355968] env[69506]: INFO networking_nsxv3.common.synchronization [req-5fd18f8a-fa31-4409-ae32-894ad8d6f9f2 req-44ebce0b-432f-4b3d-bc60-123c0e142acf tempest-ServersTestManualDisk-744845154 tempest-ServersTestManualDisk-744845154-project-member] Enqueued Resource ID: 77834f91-37e7-4feb-86e1-583e68d3d852 with Priority: HIGHEST for action security_group_members [ 1000.356510] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77834f91-37e7-4feb-86e1-583e68d3d852 with Priority: HIGHEST for action security_group_members [ 1000.356771] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-77834f91-37e7-4feb-86e1-583e68d3d852 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.356894] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.356949] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.357153] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.357298] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.357404] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.357468] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.357608] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.357688] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.357776] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77834f91-37e7-4feb-86e1-583e68d3d852',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.401916] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.402121] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.402202] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.402407] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.402552] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.417894] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a in Status: IN_PROGRESS for 2s [ 1000.510938] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.511274] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.511387] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.511648] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.511801] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.511966] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 5e732b1d-3f2b-4011-9f60-5340f5cf8ac5 not found, creating... [ 1000.512255] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.512418] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.512541] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.513011] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.513011] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.513213] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.513377] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.513501] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.513716] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.513857] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.514013] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 5e732b1d-3f2b-4011-9f60-5340f5cf8ac5 is going to be created. [ 1000.541923] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.542855] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.542855] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.542980] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.543192] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.543435] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-5e732b1d-3f2b-4011-9f60-5340f5cf8ac5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.590912] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d52cf5b6-2860-4667-8ade-9e0529358ed1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.599482] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.599637] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.599711] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.600186] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.600404] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.600537] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7dad645-1b67-495c-8fe3-ab50c7737c6c is going to be created. [ 1000.640780] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.640986] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.641162] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.641391] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.642197] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.680463] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7dad645-1b67-495c-8fe3-ab50c7737c6c in Status: UNINITIALIZED for 2s [ 1000.749583] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8ff5e5b-5797-4254-b957-602d11e125dd taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.749742] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8ff5e5b-5797-4254-b957-602d11e125dd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.749843] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8ff5e5b-5797-4254-b957-602d11e125dd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.750133] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8ff5e5b-5797-4254-b957-602d11e125dd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.750307] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.750415] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.750644] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.750644] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.750749] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.750825] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8ff5e5b-5797-4254-b957-602d11e125dd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.750998] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8ff5e5b-5797-4254-b957-602d11e125dd taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.751112] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8ff5e5b-5797-4254-b957-602d11e125dd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.751169] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8ff5e5b-5797-4254-b957-602d11e125dd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.751353] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8ff5e5b-5797-4254-b957-602d11e125dd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.751458] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.751551] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.751607] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.751743] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.751815] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.751900] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8ff5e5b-5797-4254-b957-602d11e125dd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.751992] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8ff5e5b-5797-4254-b957-602d11e125dd',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.860210] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.860403] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.860446] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.860670] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.881033] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.881202] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.881279] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.881279] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.881512] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.881581] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.881643] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77834f91-37e7-4feb-86e1-583e68d3d852 is going to be updated. [ 1000.906363] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.906523] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.906622] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.906877] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.907047] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.915240] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77834f91-37e7-4feb-86e1-583e68d3d852 in Status: IN_PROGRESS for 2s [ 1001.093803] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d52cf5b6-2860-4667-8ade-9e0529358ed1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.255262] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8ff5e5b-5797-4254-b957-602d11e125dd: rpc.has_security_group_logging(os_id): False [ 1001.272526] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.272772] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.272772] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.272939] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.273045] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.273964] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.273964] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.273964] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.273964] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.273964] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.273964] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.273964] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.273964] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.274814] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.274814] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.274814] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.274814] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.274814] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.274814] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.274814] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.274814] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8ff5e5b-5797-4254-b957-602d11e125dd is going to be created. [ 1001.289443] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 in Status: SUCCESS [ 1001.289662] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.289836] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.290115] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.290208] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d52cf5b6-2860-4667-8ade-9e0529358ed1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.328450] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.328872] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.328872] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.328872] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.328872] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.331624] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 in Status: SUCCESS [ 1001.331728] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.339213] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8ff5e5b-5797-4254-b957-602d11e125dd in Status: IN_PROGRESS for 2s [ 1001.360343] env[69506]: INFO networking_nsxv3.common.synchronization [req-e83f2ccc-20ce-42fc-9160-98f91feef857 req-4ca66629-ba94-43ca-9cc4-38bfdd586b59 service nova] Enqueued Resource ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 with Priority: HIGHEST for action security_group_rules [ 1001.360470] env[69506]: INFO networking_nsxv3.common.synchronization [req-e83f2ccc-20ce-42fc-9160-98f91feef857 req-4ca66629-ba94-43ca-9cc4-38bfdd586b59 service nova] Enqueued Resource ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 with Priority: HIGHEST for action security_group_members [ 1001.360610] env[69506]: INFO networking_nsxv3.common.synchronization [req-e83f2ccc-20ce-42fc-9160-98f91feef857 req-4ca66629-ba94-43ca-9cc4-38bfdd586b59 service nova] Enqueued Resource ID: 5e732b1d-3f2b-4011-9f60-5340f5cf8ac5 with Priority: HIGHEST for action port [ 1001.360832] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 with Priority: HIGHEST for action security_group_rules [ 1001.360969] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 with Priority: HIGHEST for action security_group_members [ 1001.361079] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e732b1d-3f2b-4011-9f60-5340f5cf8ac5 with Priority: HIGHEST for action port [ 1001.361610] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f946d66-543a-40be-9347-81d7eb4f4e31 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.361729] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.361788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.362425] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.364217] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.365831] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f946d66-543a-40be-9347-81d7eb4f4e31 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.365831] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.365831] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.365831] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.365831] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.365831] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.365831] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.366134] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.366492] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.366589] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.367502] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e732b1d-3f2b-4011-9f60-5340f5cf8ac5 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.367609] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e732b1d-3f2b-4011-9f60-5340f5cf8ac5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.367676] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e732b1d-3f2b-4011-9f60-5340f5cf8ac5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.367827] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e732b1d-3f2b-4011-9f60-5340f5cf8ac5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.367900] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e732b1d-3f2b-4011-9f60-5340f5cf8ac5',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.597776] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.598010] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.598062] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.598268] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.599081] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.599081] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 is going to be updated. [ 1001.633200] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.633401] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.633401] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.633606] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.633748] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.641949] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 in Status: IN_PROGRESS for 2s [ 1001.793341] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52cf5b6-2860-4667-8ade-9e0529358ed1 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.793547] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.870032] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5e732b1d-3f2b-4011-9f60-5340f5cf8ac5 with status ACTIVE [ 1001.870286] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.870428] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.870498] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.870718] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.870806] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.870988] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.871110] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.871174] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.871328] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.871405] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.871592] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.871679] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.871734] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.871873] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.871946] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.872041] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5e732b1d-3f2b-4011-9f60-5340f5cf8ac5 is going to be updated. [ 1001.873323] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f946d66-543a-40be-9347-81d7eb4f4e31 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.873416] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.873596] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.913275] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.913420] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.913498] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.913782] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.913850] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.914027] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e732b1d-3f2b-4011-9f60-5340f5cf8ac5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.376419] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.430678] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a in Status: SUCCESS [ 1002.430980] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.431633] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.431928] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.432073] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.691544] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7dad645-1b67-495c-8fe3-ab50c7737c6c in Status: SUCCESS [ 1002.691765] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7dad645-1b67-495c-8fe3-ab50c7737c6c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.691962] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7dad645-1b67-495c-8fe3-ab50c7737c6c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.692277] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7dad645-1b67-495c-8fe3-ab50c7737c6c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.692394] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.692473] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.692550] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.692681] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.692759] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.692843] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7dad645-1b67-495c-8fe3-ab50c7737c6c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.692940] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7dad645-1b67-495c-8fe3-ab50c7737c6c',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.882924] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.883113] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.883162] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.883383] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.883470] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.884150] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 is going to be updated. [ 1002.911972] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.913104] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.913104] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.913104] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.913104] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.924489] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77834f91-37e7-4feb-86e1-583e68d3d852 in Status: SUCCESS [ 1002.924671] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77834f91-37e7-4feb-86e1-583e68d3d852 deletion is rescheduled due to dependency. [ 1002.924780] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.925482] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 in Status: IN_PROGRESS for 2s [ 1002.935195] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbe38da-467a-45a1-9704-6b9d3f78430a taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.935195] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.935195] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.935195] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.935195] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.935195] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.935195] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.935195] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.935195] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.935195] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.935661] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.194962] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7dad645-1b67-495c-8fe3-ab50c7737c6c taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.195175] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7dad645-1b67-495c-8fe3-ab50c7737c6c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.195252] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7dad645-1b67-495c-8fe3-ab50c7737c6c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.195476] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7dad645-1b67-495c-8fe3-ab50c7737c6c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.195649] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.195875] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.195875] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.195949] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.196125] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.196125] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7dad645-1b67-495c-8fe3-ab50c7737c6c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.196264] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7dad645-1b67-495c-8fe3-ab50c7737c6c taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.196357] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7dad645-1b67-495c-8fe3-ab50c7737c6c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.196418] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7dad645-1b67-495c-8fe3-ab50c7737c6c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.196610] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7dad645-1b67-495c-8fe3-ab50c7737c6c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.196810] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.196810] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.197752] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.197752] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.197752] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.197752] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7dad645-1b67-495c-8fe3-ab50c7737c6c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.197752] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7dad645-1b67-495c-8fe3-ab50c7737c6c',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.268897] env[69506]: INFO networking_nsxv3.common.synchronization [None req-ea1076c9-05fb-4a88-b54a-86cc460b4b47 None None] Enqueued Resource ID: 2dadd49b-aa45-4c4c-8650-54760a1b9ef0 with Priority: HIGHEST for action port [ 1003.269112] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dadd49b-aa45-4c4c-8650-54760a1b9ef0 with Priority: HIGHEST for action port [ 1003.269667] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-2dadd49b-aa45-4c4c-8650-54760a1b9ef0 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.269803] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2dadd49b-aa45-4c4c-8650-54760a1b9ef0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.269962] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2dadd49b-aa45-4c4c-8650-54760a1b9ef0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.270232] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2dadd49b-aa45-4c4c-8650-54760a1b9ef0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.270232] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2dadd49b-aa45-4c4c-8650-54760a1b9ef0',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.352079] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8ff5e5b-5797-4254-b957-602d11e125dd in Status: SUCCESS [ 1003.353641] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8ff5e5b-5797-4254-b957-602d11e125dd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.439054] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbe38da-467a-45a1-9704-6b9d3f78430a taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.439345] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.439345] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.439594] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.439826] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.439968] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.440049] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.440207] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.440294] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.440401] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.440561] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbe38da-467a-45a1-9704-6b9d3f78430a taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.440695] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.440773] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.440975] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.441196] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.441296] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.441373] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.441518] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.441597] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.441892] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.441892] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.653029] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 in Status: SUCCESS [ 1003.653029] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.653029] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.653029] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.653029] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.653029] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.653029] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.653029] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.653029] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.653029] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.653029] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d52cf5b6-2860-4667-8ade-9e0529358ed1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.701218] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7dad645-1b67-495c-8fe3-ab50c7737c6c: rpc.has_security_group_logging(os_id): False [ 1003.720032] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.720032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.720032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.720032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.720032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.720032] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.720032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.720032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.720032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.720032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.720032] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.720032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.720032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.720032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.720032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.720675] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.720675] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.720675] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.720675] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.720675] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.720675] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7dad645-1b67-495c-8fe3-ab50c7737c6c is going to be created. [ 1003.778036] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2dadd49b-aa45-4c4c-8650-54760a1b9ef0 [ 1003.778036] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.778036] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.778036] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.778036] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.778036] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.778036] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2dadd49b-aa45-4c4c-8650-54760a1b9ef0 already deleted. [ 1003.778036] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2dadd49b-aa45-4c4c-8650-54760a1b9ef0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.778036] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.779661] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.784034] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.784034] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.784034] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.795134] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7dad645-1b67-495c-8fe3-ab50c7737c6c in Status: IN_PROGRESS for 2s [ 1003.943943] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2dbe38da-467a-45a1-9704-6b9d3f78430a: rpc.has_security_group_logging(os_id): False [ 1003.964878] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.964878] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.964878] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.964878] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.964878] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.965310] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.965310] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.965310] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.965435] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.965480] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.965860] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.965860] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.965860] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.966034] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.966034] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.970571] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.970696] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.970751] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.971122] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.971122] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.971389] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a is going to be updated. [ 1004.032314] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.032478] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.032550] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.032766] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.032907] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.053110] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a in Status: IN_PROGRESS for 2s [ 1004.157046] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52cf5b6-2860-4667-8ade-9e0529358ed1 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.157232] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.157299] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.157514] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.157684] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.157803] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.157905] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.158091] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.158181] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.158270] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.158423] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52cf5b6-2860-4667-8ade-9e0529358ed1 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.158526] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.158587] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.158726] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.158863] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.158953] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.159024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.159162] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.159239] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.159313] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.159402] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d52cf5b6-2860-4667-8ade-9e0529358ed1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.563305] env[69506]: INFO networking_nsxv3.common.synchronization [None req-3c85af7f-1f1a-4a09-99a0-52d30c6d5087 tempest-ServersTestFqdnHostnames-1516588989 tempest-ServersTestFqdnHostnames-1516588989-project-member] Enqueued Resource ID: eee25a0e-a423-45cd-80e8-327029ae7dc4 with Priority: HIGHEST for action security_group_rules [ 1004.565618] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eee25a0e-a423-45cd-80e8-327029ae7dc4 with Priority: HIGHEST for action security_group_rules [ 1004.565618] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eee25a0e-a423-45cd-80e8-327029ae7dc4 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.565837] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eee25a0e-a423-45cd-80e8-327029ae7dc4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.565837] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eee25a0e-a423-45cd-80e8-327029ae7dc4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.570018] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eee25a0e-a423-45cd-80e8-327029ae7dc4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.570018] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eee25a0e-a423-45cd-80e8-327029ae7dc4',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.662332] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d52cf5b6-2860-4667-8ade-9e0529358ed1: rpc.has_security_group_logging(os_id): False [ 1004.679183] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.679183] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.679366] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.679507] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.679598] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.679802] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.679919] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.679996] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.680176] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.680260] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.680482] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.680583] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.680647] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.681284] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.681284] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.681507] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.681507] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.681773] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.681773] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.681773] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.681986] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 is going to be updated. [ 1004.715487] env[69506]: INFO networking_nsxv3.common.synchronization [None req-e560f549-776a-4069-b332-eaa2e8dc40c1 tempest-ServersTestFqdnHostnames-1516588989 tempest-ServersTestFqdnHostnames-1516588989-project-member] Enqueued Resource ID: eee25a0e-a423-45cd-80e8-327029ae7dc4 with Priority: HIGHEST for action security_group_rules [ 1004.716088] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eee25a0e-a423-45cd-80e8-327029ae7dc4 with Priority: HIGHEST for action security_group_rules [ 1004.716212] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eee25a0e-a423-45cd-80e8-327029ae7dc4 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.716343] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eee25a0e-a423-45cd-80e8-327029ae7dc4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.738621] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.738836] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.738925] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.739240] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.739440] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.752360] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 in Status: IN_PROGRESS for 2s [ 1004.936155] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 in Status: SUCCESS [ 1004.936650] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.936974] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.937351] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.937640] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.937878] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.938033] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.938280] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.938506] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.938706] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.938938] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.088846] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.090428] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.090428] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.090428] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.090428] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.090428] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eee25a0e-a423-45cd-80e8-327029ae7dc4 already deleted. [ 1005.090428] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eee25a0e-a423-45cd-80e8-327029ae7dc4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.090428] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eee25a0e-a423-45cd-80e8-327029ae7dc4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.090428] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eee25a0e-a423-45cd-80e8-327029ae7dc4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.090428] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eee25a0e-a423-45cd-80e8-327029ae7dc4',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.442034] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f946d66-543a-40be-9347-81d7eb4f4e31 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.442034] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.442167] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.442352] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.442529] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.442636] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.442701] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.442850] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.442939] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.443089] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.443288] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f946d66-543a-40be-9347-81d7eb4f4e31 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.443448] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.443448] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.443576] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.443713] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.443803] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.443865] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.444010] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.444088] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.444167] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.444256] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.611389] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.611656] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.611656] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.611781] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.612443] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.612603] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eee25a0e-a423-45cd-80e8-327029ae7dc4 already deleted. [ 1005.612721] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eee25a0e-a423-45cd-80e8-327029ae7dc4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.809748] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7dad645-1b67-495c-8fe3-ab50c7737c6c in Status: SUCCESS [ 1005.810032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7dad645-1b67-495c-8fe3-ab50c7737c6c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.886026] env[69506]: INFO networking_nsxv3.common.synchronization [None req-86dc81ea-168d-4a62-bc39-37cfa22085b7 None None] Enqueued Resource ID: 5dbdc8ea-5831-4392-9642-73523e45983c with Priority: HIGHEST for action port [ 1005.886302] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dbdc8ea-5831-4392-9642-73523e45983c with Priority: HIGHEST for action port [ 1005.886865] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-5dbdc8ea-5831-4392-9642-73523e45983c taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.886989] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5dbdc8ea-5831-4392-9642-73523e45983c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.887864] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5dbdc8ea-5831-4392-9642-73523e45983c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.888241] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5dbdc8ea-5831-4392-9642-73523e45983c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.888303] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5dbdc8ea-5831-4392-9642-73523e45983c',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.946776] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3f946d66-543a-40be-9347-81d7eb4f4e31: rpc.has_security_group_logging(os_id): False [ 1005.964552] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.964759] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.964759] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.966326] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.966326] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.966506] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.966695] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.966695] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.966841] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.966931] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.969066] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.969175] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.969214] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.969748] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.969748] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.969748] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.969748] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.969748] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.970209] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.970752] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.970752] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 is going to be updated. [ 1006.029669] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.029838] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.029956] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.030186] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.030324] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.044380] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 in Status: IN_PROGRESS for 2s [ 1006.064040] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a in Status: SUCCESS [ 1006.064040] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.143032] env[69506]: INFO networking_nsxv3.common.synchronization [req-e84178f0-1a3f-416d-a941-aecffe8b13f7 req-41d337bb-7bb2-4777-a1fd-ca5aaec0a97d tempest-ServersTestMultiNic-1599747181 tempest-ServersTestMultiNic-1599747181-project-member] Enqueued Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_members [ 1006.143032] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_members [ 1006.143032] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbe38da-467a-45a1-9704-6b9d3f78430a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.143032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.143032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.143032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.143032] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.143032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.143032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.144504] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.144504] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.144504] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.393020] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5dbdc8ea-5831-4392-9642-73523e45983c [ 1006.393020] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.393020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.393020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.393020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.393020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.393020] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5dbdc8ea-5831-4392-9642-73523e45983c already deleted. [ 1006.393020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5dbdc8ea-5831-4392-9642-73523e45983c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.458271] env[69506]: INFO networking_nsxv3.common.synchronization [req-92a9527c-74ce-45cc-9865-8470c9ee94dd req-707e4b07-ed71-41dd-b2f9-bca3a374ea90 tempest-ServerActionsV293TestJSON-229040708 tempest-ServerActionsV293TestJSON-229040708-project-member] Enqueued Resource ID: 0210561b-43ff-434b-97ef-339a5d85a2a9 with Priority: HIGHEST for action security_group_members [ 1006.458970] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0210561b-43ff-434b-97ef-339a5d85a2a9 with Priority: HIGHEST for action security_group_members [ 1006.459290] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0210561b-43ff-434b-97ef-339a5d85a2a9 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.460080] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0210561b-43ff-434b-97ef-339a5d85a2a9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.460080] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0210561b-43ff-434b-97ef-339a5d85a2a9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.460080] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0210561b-43ff-434b-97ef-339a5d85a2a9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.460244] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.460244] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.460333] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.460582] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.460715] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.460814] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0210561b-43ff-434b-97ef-339a5d85a2a9',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.483752] env[69506]: INFO networking_nsxv3.common.synchronization [req-efe3b268-73a0-4255-87b0-ce5e85a99341 req-e94e3745-2512-43bc-9993-ef69aac48005 tempest-ServerDiskConfigTestJSON-583020681 tempest-ServerDiskConfigTestJSON-583020681-project-member] Enqueued Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_members [ 1006.484253] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_members [ 1006.484721] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-008501d4-938b-4336-9c1d-ef3665f7d09d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.484721] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.484721] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.484904] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.485743] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.485743] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.485743] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.485743] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.485743] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.485743] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.589556] env[69506]: INFO networking_nsxv3.common.synchronization [req-e84178f0-1a3f-416d-a941-aecffe8b13f7 req-44e7b1d2-b837-4931-a944-5b98d7321d22 tempest-ServersTestMultiNic-1599747181 tempest-ServersTestMultiNic-1599747181-project-member] Enqueued Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_members [ 1006.591637] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_members [ 1006.591722] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbe38da-467a-45a1-9704-6b9d3f78430a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.591782] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.649845] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.765128] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 in Status: SUCCESS [ 1006.765415] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.898849] env[69506]: INFO networking_nsxv3.common.synchronization [req-e84178f0-1a3f-416d-a941-aecffe8b13f7 req-6ab7ea28-3b3d-4d8e-85e0-69e9ffe9bb9e tempest-ServersTestMultiNic-1599747181 tempest-ServersTestMultiNic-1599747181-project-member] Enqueued Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_members [ 1006.899413] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_members [ 1006.900519] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbe38da-467a-45a1-9704-6b9d3f78430a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.900519] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.963259] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.963588] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.963688] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.963891] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.992061] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.992395] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.998210] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.998210] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.998210] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.998210] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.998506] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.998506] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.998506] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0210561b-43ff-434b-97ef-339a5d85a2a9 is going to be updated. [ 1006.999675] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.999903] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.002785] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.003074] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.003222] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.003331] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.003543] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.003626] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.003718] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 008501d4-938b-4336-9c1d-ef3665f7d09d is going to be updated. [ 1007.022714] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-350 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.022714] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-350" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.022714] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-350" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.022714] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-350" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.022714] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.023748] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.023928] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.024245] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.024861] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.025179] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1007.025264] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1007.025379] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1007.025518] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1007.025695] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1007.025852] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1007.026024] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1007.032777] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.032907] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.032954] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.033385] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.033526] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.035497] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.035719] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.035799] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.035962] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.036093] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.048377] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0210561b-43ff-434b-97ef-339a5d85a2a9 in Status: IN_PROGRESS for 2s [ 1007.049015] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 008501d4-938b-4336-9c1d-ef3665f7d09d in Status: IN_PROGRESS for 2s [ 1007.062343] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1007.062571] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1007.062716] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1007.063152] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-350" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.063518] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-c63bc458-84cd-4e15-8edd-298115a7b892 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.063700] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-c63bc458-84cd-4e15-8edd-298115a7b892" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.063858] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-c63bc458-84cd-4e15-8edd-298115a7b892" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.065147] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-c63bc458-84cd-4e15-8edd-298115a7b892" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.065312] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c63bc458-84cd-4e15-8edd-298115a7b892',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.154587] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.568243] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.568457] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.568683] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.568946] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.569385] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.569385] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port c63bc458-84cd-4e15-8edd-298115a7b892 not found, creating... [ 1007.570019] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.570019] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.570019] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.570246] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.570399] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.570721] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.570914] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.571160] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.571807] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.571807] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.571807] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: c63bc458-84cd-4e15-8edd-298115a7b892 is going to be created. [ 1007.595047] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.595484] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.596233] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.596233] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.596808] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.596808] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-c63bc458-84cd-4e15-8edd-298115a7b892" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.658168] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.658474] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.658474] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.658626] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.658717] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.659099] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a is going to be updated. [ 1007.692325] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.693247] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.693247] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.693515] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.693557] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.708341] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a in Status: IN_PROGRESS for 2s [ 1008.057241] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 in Status: SUCCESS [ 1008.057529] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.552259] env[69506]: INFO networking_nsxv3.common.synchronization [req-efe3b268-73a0-4255-87b0-ce5e85a99341 req-6e229886-4513-45fa-8541-47bf2d07027e service nova] Enqueued Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_rules [ 1008.552259] env[69506]: INFO networking_nsxv3.common.synchronization [req-efe3b268-73a0-4255-87b0-ce5e85a99341 req-6e229886-4513-45fa-8541-47bf2d07027e service nova] Enqueued Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_members [ 1008.552259] env[69506]: INFO networking_nsxv3.common.synchronization [req-efe3b268-73a0-4255-87b0-ce5e85a99341 req-6e229886-4513-45fa-8541-47bf2d07027e service nova] Enqueued Resource ID: c63bc458-84cd-4e15-8edd-298115a7b892 with Priority: HIGHEST for action port [ 1008.552259] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_rules [ 1008.552502] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_members [ 1008.552502] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c63bc458-84cd-4e15-8edd-298115a7b892 with Priority: HIGHEST for action port [ 1008.553392] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-008501d4-938b-4336-9c1d-ef3665f7d09d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.553392] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.553392] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.553572] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.553572] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.554490] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-008501d4-938b-4336-9c1d-ef3665f7d09d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.554677] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.555360] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-c63bc458-84cd-4e15-8edd-298115a7b892 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.555360] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c63bc458-84cd-4e15-8edd-298115a7b892" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.555360] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c63bc458-84cd-4e15-8edd-298115a7b892" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.555360] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c63bc458-84cd-4e15-8edd-298115a7b892" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.555360] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c63bc458-84cd-4e15-8edd-298115a7b892',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.868082] env[69506]: INFO networking_nsxv3.common.synchronization [req-d517e547-aade-4506-bf30-4344f1f737bf req-b41feceb-69a4-4540-b823-9f501f545438 tempest-InstanceActionsTestJSON-587208907 tempest-InstanceActionsTestJSON-587208907-project-member] Enqueued Resource ID: 17f09989-f208-4cef-8aea-94e818aa9a91 with Priority: HIGHEST for action security_group_members [ 1008.868082] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17f09989-f208-4cef-8aea-94e818aa9a91 with Priority: HIGHEST for action security_group_members [ 1008.868082] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-17f09989-f208-4cef-8aea-94e818aa9a91 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.868082] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17f09989-f208-4cef-8aea-94e818aa9a91" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.868082] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17f09989-f208-4cef-8aea-94e818aa9a91" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.869735] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17f09989-f208-4cef-8aea-94e818aa9a91" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.869958] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.871077] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.871077] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.871077] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.871077] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.871077] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17f09989-f208-4cef-8aea-94e818aa9a91',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.057078] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-008501d4-938b-4336-9c1d-ef3665f7d09d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.057078] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.057315] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c63bc458-84cd-4e15-8edd-298115a7b892 with status ACTIVE [ 1009.057516] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.057674] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.057773] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.058336] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.058485] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.058708] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.058859] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.059067] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.059154] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.059255] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.059440] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.059540] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.059908] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.059908] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.059908] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.060064] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c63bc458-84cd-4e15-8edd-298115a7b892 is going to be updated. [ 1009.062773] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0210561b-43ff-434b-97ef-339a5d85a2a9 in Status: SUCCESS [ 1009.063055] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0210561b-43ff-434b-97ef-339a5d85a2a9 deletion is rescheduled due to dependency. [ 1009.063150] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0210561b-43ff-434b-97ef-339a5d85a2a9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.063986] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 008501d4-938b-4336-9c1d-ef3665f7d09d in Status: SUCCESS [ 1009.064423] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 008501d4-938b-4336-9c1d-ef3665f7d09d deletion is rescheduled due to dependency. [ 1009.064543] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.064841] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.065268] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.065486] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.065925] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.066264] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.066264] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.066380] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.071957] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.091227] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.091378] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.091436] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.091662] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.091808] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.091966] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c63bc458-84cd-4e15-8edd-298115a7b892" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.376366] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.376518] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.376587] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.376802] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.376894] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.377109] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.377198] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.377267] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.377419] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.377496] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.377583] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17f09989-f208-4cef-8aea-94e818aa9a91 already deleted. [ 1009.377664] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17f09989-f208-4cef-8aea-94e818aa9a91" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.572946] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.594152] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-12 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.594349] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-12" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.594473] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-12" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.594791] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-12" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.595650] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.595883] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.597807] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.598103] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.598265] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.601412] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1009.601412] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1009.601412] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1009.601412] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1009.601412] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1009.601412] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1009.601412] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1009.616444] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1009.617044] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1009.617044] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1009.617044] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-12" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.617385] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-39a686f5-78b5-47c5-bd73-375b42a555c5 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.617565] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-39a686f5-78b5-47c5-bd73-375b42a555c5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.617916] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-39a686f5-78b5-47c5-bd73-375b42a555c5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.618291] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-39a686f5-78b5-47c5-bd73-375b42a555c5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.618446] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39a686f5-78b5-47c5-bd73-375b42a555c5',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.722985] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a in Status: SUCCESS [ 1009.722985] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.722985] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.722985] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.722985] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.722985] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.722985] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.722985] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.722985] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.722985] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.077642] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.121853] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.122023] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.122330] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.122765] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.124022] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.124022] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 39a686f5-78b5-47c5-bd73-375b42a555c5 not found, creating... [ 1010.124315] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.124767] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.128176] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.128176] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.128176] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.128176] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.128176] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.128176] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.128176] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.128176] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.128176] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 39a686f5-78b5-47c5-bd73-375b42a555c5 is going to be created. [ 1010.140156] env[69506]: INFO networking_nsxv3.common.synchronization [None req-8d95c628-87a4-4ef0-b2c7-71fe5eb5a27c tempest-ServerActionsTestJSON-78405165 tempest-ServerActionsTestJSON-78405165-project-member] Enqueued Resource ID: c141011f-1c58-45cb-b73c-ad882255b77a with Priority: HIGHEST for action security_group_rules [ 1010.140156] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c141011f-1c58-45cb-b73c-ad882255b77a with Priority: HIGHEST for action security_group_rules [ 1010.140156] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c141011f-1c58-45cb-b73c-ad882255b77a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.140156] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c141011f-1c58-45cb-b73c-ad882255b77a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.140156] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c141011f-1c58-45cb-b73c-ad882255b77a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.140156] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c141011f-1c58-45cb-b73c-ad882255b77a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.140980] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c141011f-1c58-45cb-b73c-ad882255b77a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.150061] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.151930] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.152536] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.153626] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.154071] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.155194] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-39a686f5-78b5-47c5-bd73-375b42a555c5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.185195] env[69506]: INFO networking_nsxv3.common.synchronization [None req-a6bb6012-6590-4d5e-898a-af94ea6e7291 None None] Enqueued Resource ID: b0cd87df-e878-4b78-a32e-8c1a309f3349 with Priority: HIGHEST for action port [ 1010.185195] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0cd87df-e878-4b78-a32e-8c1a309f3349 with Priority: HIGHEST for action port [ 1010.185195] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0cd87df-e878-4b78-a32e-8c1a309f3349 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.185195] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0cd87df-e878-4b78-a32e-8c1a309f3349" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.185195] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0cd87df-e878-4b78-a32e-8c1a309f3349" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.185875] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0cd87df-e878-4b78-a32e-8c1a309f3349" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.186057] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0cd87df-e878-4b78-a32e-8c1a309f3349',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.225546] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.226043] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.226423] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.229028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.229028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.229028] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.229028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.229028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.229028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.229028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.229028] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a is going to be updated. [ 1010.271148] env[69506]: INFO networking_nsxv3.common.synchronization [None req-8b526630-b201-4d3e-8d8d-26cc09b76037 tempest-ServerActionsTestJSON-78405165 tempest-ServerActionsTestJSON-78405165-project-member] Enqueued Resource ID: c141011f-1c58-45cb-b73c-ad882255b77a with Priority: HIGHEST for action security_group_rules [ 1010.271148] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c141011f-1c58-45cb-b73c-ad882255b77a with Priority: HIGHEST for action security_group_rules [ 1010.272027] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c141011f-1c58-45cb-b73c-ad882255b77a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.272304] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c141011f-1c58-45cb-b73c-ad882255b77a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.283257] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.283408] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.283474] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.283689] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.283826] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.302671] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a in Status: IN_PROGRESS for 2s [ 1010.582211] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.583025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.583025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.583025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.583025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.583025] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 008501d4-938b-4336-9c1d-ef3665f7d09d is going to be updated. [ 1010.612769] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.612945] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.613035] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.613298] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.613444] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.623149] env[69506]: INFO networking_nsxv3.common.synchronization [req-9724282c-8a92-4436-b6ff-c2b32a81d292 req-253ace0d-7475-4c21-b7fc-5d1f1229488b tempest-ServerAddressesNegativeTestJSON-632973573 tempest-ServerAddressesNegativeTestJSON-632973573-project-member] Enqueued Resource ID: f7dad645-1b67-495c-8fe3-ab50c7737c6c with Priority: HIGHEST for action security_group_members [ 1010.623149] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 008501d4-938b-4336-9c1d-ef3665f7d09d in Status: IN_PROGRESS for 2s [ 1010.623681] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7dad645-1b67-495c-8fe3-ab50c7737c6c with Priority: HIGHEST for action security_group_members [ 1010.623681] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7dad645-1b67-495c-8fe3-ab50c7737c6c taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.623769] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7dad645-1b67-495c-8fe3-ab50c7737c6c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.623801] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7dad645-1b67-495c-8fe3-ab50c7737c6c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.623967] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7dad645-1b67-495c-8fe3-ab50c7737c6c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.624130] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.624248] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.624323] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.627326] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.627326] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.627326] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7dad645-1b67-495c-8fe3-ab50c7737c6c',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.667630] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.668490] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.668490] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.668490] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.668490] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.670982] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c141011f-1c58-45cb-b73c-ad882255b77a already deleted. [ 1010.670982] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c141011f-1c58-45cb-b73c-ad882255b77a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.670982] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c141011f-1c58-45cb-b73c-ad882255b77a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.670982] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c141011f-1c58-45cb-b73c-ad882255b77a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.670982] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c141011f-1c58-45cb-b73c-ad882255b77a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.688913] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b0cd87df-e878-4b78-a32e-8c1a309f3349 [ 1010.689928] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.689928] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.689928] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.689928] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.689928] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.690445] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b0cd87df-e878-4b78-a32e-8c1a309f3349 already deleted. [ 1010.690445] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0cd87df-e878-4b78-a32e-8c1a309f3349" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.128415] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.128818] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.128818] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.128921] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.128963] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.131954] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.131954] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.131954] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.131954] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.131954] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.131954] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7dad645-1b67-495c-8fe3-ab50c7737c6c is going to be updated. [ 1011.175029] env[69506]: INFO networking_nsxv3.common.synchronization [req-d517e547-aade-4506-bf30-4344f1f737bf req-dd44cd2f-3ec5-486e-bebf-c850158178b7 service nova] Enqueued Resource ID: 17f09989-f208-4cef-8aea-94e818aa9a91 with Priority: HIGHEST for action security_group_rules [ 1011.175029] env[69506]: INFO networking_nsxv3.common.synchronization [req-d517e547-aade-4506-bf30-4344f1f737bf req-dd44cd2f-3ec5-486e-bebf-c850158178b7 service nova] Enqueued Resource ID: 17f09989-f208-4cef-8aea-94e818aa9a91 with Priority: HIGHEST for action security_group_members [ 1011.175029] env[69506]: INFO networking_nsxv3.common.synchronization [req-d517e547-aade-4506-bf30-4344f1f737bf req-dd44cd2f-3ec5-486e-bebf-c850158178b7 service nova] Enqueued Resource ID: 39a686f5-78b5-47c5-bd73-375b42a555c5 with Priority: HIGHEST for action port [ 1011.175029] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17f09989-f208-4cef-8aea-94e818aa9a91 with Priority: HIGHEST for action security_group_rules [ 1011.175029] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17f09989-f208-4cef-8aea-94e818aa9a91 with Priority: HIGHEST for action security_group_members [ 1011.175029] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39a686f5-78b5-47c5-bd73-375b42a555c5 with Priority: HIGHEST for action port [ 1011.175029] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17f09989-f208-4cef-8aea-94e818aa9a91 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.175029] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17f09989-f208-4cef-8aea-94e818aa9a91" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.175029] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17f09989-f208-4cef-8aea-94e818aa9a91" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.175668] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17f09989-f208-4cef-8aea-94e818aa9a91" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.175894] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17f09989-f208-4cef-8aea-94e818aa9a91',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.177014] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-17f09989-f208-4cef-8aea-94e818aa9a91 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.177418] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17f09989-f208-4cef-8aea-94e818aa9a91" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.177598] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17f09989-f208-4cef-8aea-94e818aa9a91" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.177893] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17f09989-f208-4cef-8aea-94e818aa9a91" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.178211] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.178447] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.178757] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.179143] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.179331] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.179557] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17f09989-f208-4cef-8aea-94e818aa9a91',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.181580] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-39a686f5-78b5-47c5-bd73-375b42a555c5 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.181838] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39a686f5-78b5-47c5-bd73-375b42a555c5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.181999] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39a686f5-78b5-47c5-bd73-375b42a555c5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.182270] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39a686f5-78b5-47c5-bd73-375b42a555c5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.182489] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39a686f5-78b5-47c5-bd73-375b42a555c5',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.187896] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.187896] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.187896] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.187896] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.187896] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.205692] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.205692] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.205692] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.205692] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.205692] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.205692] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c141011f-1c58-45cb-b73c-ad882255b77a already deleted. [ 1011.206086] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c141011f-1c58-45cb-b73c-ad882255b77a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.207267] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7dad645-1b67-495c-8fe3-ab50c7737c6c in Status: IN_PROGRESS for 2s [ 1011.687016] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-17f09989-f208-4cef-8aea-94e818aa9a91 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.687174] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17f09989-f208-4cef-8aea-94e818aa9a91" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.687400] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('17f09989-f208-4cef-8aea-94e818aa9a91',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.694211] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 39a686f5-78b5-47c5-bd73-375b42a555c5 with status ACTIVE [ 1011.694453] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.694581] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.694728] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.694992] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.695067] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.695444] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.695444] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.695444] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.695603] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.695603] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.697842] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.697842] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.697842] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.697842] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.697842] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.697842] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 39a686f5-78b5-47c5-bd73-375b42a555c5 is going to be updated. [ 1011.719191] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.719462] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.719462] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.719877] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.719877] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.719877] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39a686f5-78b5-47c5-bd73-375b42a555c5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.721898] env[69506]: INFO networking_nsxv3.common.synchronization [req-afb11bc2-548b-4703-b852-13d685f99a92 req-fbe423ed-4c5a-4a04-870a-032f0242e16a tempest-ImagesOneServerNegativeTestJSON-1660335094 tempest-ImagesOneServerNegativeTestJSON-1660335094-project-member] Enqueued Resource ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 with Priority: HIGHEST for action security_group_members [ 1011.722406] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 with Priority: HIGHEST for action security_group_members [ 1011.722702] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bc29505-f5b4-4554-85b9-541273bd8da3 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.722813] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.722874] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.723061] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.723203] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.723298] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.723354] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.723492] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.723571] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.723659] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bc29505-f5b4-4554-85b9-541273bd8da3',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.805717] env[69506]: INFO networking_nsxv3.common.synchronization [req-8bf97735-be9c-4836-8b62-f786a1491a08 req-ea89f0a3-5e63-422c-8b6e-a7df091ffe6d tempest-ServerMetadataTestJSON-1686448456 tempest-ServerMetadataTestJSON-1686448456-project-member] Enqueued Resource ID: d8ff5e5b-5797-4254-b957-602d11e125dd with Priority: HIGHEST for action security_group_members [ 1011.806292] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8ff5e5b-5797-4254-b957-602d11e125dd with Priority: HIGHEST for action security_group_members [ 1011.806628] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8ff5e5b-5797-4254-b957-602d11e125dd taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.806773] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8ff5e5b-5797-4254-b957-602d11e125dd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.806887] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8ff5e5b-5797-4254-b957-602d11e125dd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.807405] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8ff5e5b-5797-4254-b957-602d11e125dd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.807609] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.807727] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.807862] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.807936] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.808036] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.808405] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8ff5e5b-5797-4254-b957-602d11e125dd',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.189389] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('17f09989-f208-4cef-8aea-94e818aa9a91',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.228154] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.228321] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.228394] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.228603] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.228697] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.228905] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.229010] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.229077] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.229228] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.229304] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.229404] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 is going to be updated. [ 1012.258589] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.258589] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.258589] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.258589] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.258812] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.266596] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 in Status: IN_PROGRESS for 2s [ 1012.315245] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a in Status: SUCCESS [ 1012.315245] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a deletion is rescheduled due to dependency. [ 1012.315245] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.315245] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.315245] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.315245] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.315245] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.315245] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.315245] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.315245] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.315245] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.315245] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.315245] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.315245] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8ff5e5b-5797-4254-b957-602d11e125dd is going to be updated. [ 1012.316077] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.316487] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.316803] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.317570] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.317673] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.318647] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.318739] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.318835] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.345093] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.345093] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.345254] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.345501] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.345656] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.355052] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8ff5e5b-5797-4254-b957-602d11e125dd in Status: IN_PROGRESS for 2s [ 1012.468888] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-370 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.468888] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-370" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.468888] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-370" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.468888] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-370" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.470220] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.471152] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.472624] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.473055] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.473871] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.473871] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1012.473871] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1012.476023] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1012.476023] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1012.476023] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1012.476023] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1012.476023] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1012.493828] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1012.495042] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1012.495413] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1012.495890] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-370" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.498052] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-24e2e8fa-0e01-42df-8a41-28d2438bbf41 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.498052] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-24e2e8fa-0e01-42df-8a41-28d2438bbf41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.498052] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-24e2e8fa-0e01-42df-8a41-28d2438bbf41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.498052] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-24e2e8fa-0e01-42df-8a41-28d2438bbf41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.498052] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24e2e8fa-0e01-42df-8a41-28d2438bbf41',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.632462] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 008501d4-938b-4336-9c1d-ef3665f7d09d in Status: SUCCESS [ 1012.632695] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.632860] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.633117] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.633316] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.633581] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.633581] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.633736] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.633736] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.633814] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.633873] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.693044] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.693044] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.693044] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.693044] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.693044] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.693044] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17f09989-f208-4cef-8aea-94e818aa9a91 is going to be created. [ 1012.712249] env[69506]: INFO networking_nsxv3.common.synchronization [None req-b7d072ad-b9f9-43ee-a83a-c323fe8276d0 None None] Enqueued Resource ID: e70e6cd4-5fd8-49e7-8066-2f18d3c5e1cb with Priority: HIGHEST for action port [ 1012.712835] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e70e6cd4-5fd8-49e7-8066-2f18d3c5e1cb with Priority: HIGHEST for action port [ 1012.713253] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-e70e6cd4-5fd8-49e7-8066-2f18d3c5e1cb taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.713392] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e70e6cd4-5fd8-49e7-8066-2f18d3c5e1cb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.713598] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e70e6cd4-5fd8-49e7-8066-2f18d3c5e1cb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.713741] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e70e6cd4-5fd8-49e7-8066-2f18d3c5e1cb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.713799] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e70e6cd4-5fd8-49e7-8066-2f18d3c5e1cb',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.716284] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.716404] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.716404] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.716858] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.716858] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.725371] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17f09989-f208-4cef-8aea-94e818aa9a91 in Status: UNINITIALIZED for 2s [ 1012.822273] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.822273] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.822273] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.822273] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.822742] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.822936] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.823021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.823061] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.823225] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.823298] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.823384] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a is going to be updated. [ 1012.848981] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.849191] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.850521] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.852019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.852019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.860090] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a in Status: IN_PROGRESS for 2s [ 1013.001563] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.001563] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.001762] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.002377] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.002572] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.002724] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 24e2e8fa-0e01-42df-8a41-28d2438bbf41 not found, creating... [ 1013.002996] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.003178] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.003300] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.003527] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.003669] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.003953] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.004126] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.004245] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.004457] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.004625] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.004729] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 24e2e8fa-0e01-42df-8a41-28d2438bbf41 is going to be created. [ 1013.024876] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.025206] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.025969] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.025969] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.025969] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.026331] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-24e2e8fa-0e01-42df-8a41-28d2438bbf41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.136840] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-008501d4-938b-4336-9c1d-ef3665f7d09d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.137070] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.137155] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.137413] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.137633] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.137735] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.137834] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.138016] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.138500] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.138500] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.138500] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-008501d4-938b-4336-9c1d-ef3665f7d09d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.138633] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.138667] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.138803] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.138986] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.139107] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.139197] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.139523] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.139523] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.139523] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.139672] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.216284] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e70e6cd4-5fd8-49e7-8066-2f18d3c5e1cb [ 1013.216603] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.216674] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.217478] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.217478] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.217478] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.217478] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e70e6cd4-5fd8-49e7-8066-2f18d3c5e1cb already deleted. [ 1013.217478] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e70e6cd4-5fd8-49e7-8066-2f18d3c5e1cb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.222017] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7dad645-1b67-495c-8fe3-ab50c7737c6c in Status: SUCCESS [ 1013.222252] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7dad645-1b67-495c-8fe3-ab50c7737c6c deletion is rescheduled due to dependency. [ 1013.222347] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7dad645-1b67-495c-8fe3-ab50c7737c6c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.645041] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 008501d4-938b-4336-9c1d-ef3665f7d09d: rpc.has_security_group_logging(os_id): False [ 1013.663773] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.663773] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.663773] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.663773] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.663773] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.663773] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.663773] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.663773] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.663773] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.663773] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.663773] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.663773] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.663773] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.663773] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.664333] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.664333] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.664333] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.664333] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.664333] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.665535] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.665582] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 008501d4-938b-4336-9c1d-ef3665f7d09d is going to be updated. [ 1013.721388] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.722266] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.722751] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.723107] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.723385] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.741456] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 008501d4-938b-4336-9c1d-ef3665f7d09d in Status: IN_PROGRESS for 2s [ 1013.860581] env[69506]: INFO networking_nsxv3.common.synchronization [None req-9dca8e68-941f-44ba-abe1-7a33da78c4e2 None None] Enqueued Resource ID: 19617b8c-aea6-423c-b344-221d80fef4d7 with Priority: HIGHEST for action port [ 1013.860581] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19617b8c-aea6-423c-b344-221d80fef4d7 with Priority: HIGHEST for action port [ 1013.861125] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-19617b8c-aea6-423c-b344-221d80fef4d7 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.861271] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19617b8c-aea6-423c-b344-221d80fef4d7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.861335] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19617b8c-aea6-423c-b344-221d80fef4d7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.861578] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19617b8c-aea6-423c-b344-221d80fef4d7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.861661] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19617b8c-aea6-423c-b344-221d80fef4d7',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.034412] env[69506]: INFO networking_nsxv3.common.synchronization [req-afb11bc2-548b-4703-b852-13d685f99a92 req-2553235f-5bd8-4b33-b3f3-1246c7eba3fa service nova] Enqueued Resource ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 with Priority: HIGHEST for action security_group_rules [ 1014.034412] env[69506]: INFO networking_nsxv3.common.synchronization [req-afb11bc2-548b-4703-b852-13d685f99a92 req-2553235f-5bd8-4b33-b3f3-1246c7eba3fa service nova] Enqueued Resource ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 with Priority: HIGHEST for action security_group_members [ 1014.034412] env[69506]: INFO networking_nsxv3.common.synchronization [req-afb11bc2-548b-4703-b852-13d685f99a92 req-2553235f-5bd8-4b33-b3f3-1246c7eba3fa service nova] Enqueued Resource ID: 24e2e8fa-0e01-42df-8a41-28d2438bbf41 with Priority: HIGHEST for action port [ 1014.034412] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 with Priority: HIGHEST for action security_group_rules [ 1014.034751] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 with Priority: HIGHEST for action security_group_members [ 1014.034791] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24e2e8fa-0e01-42df-8a41-28d2438bbf41 with Priority: HIGHEST for action port [ 1014.035533] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0bc29505-f5b4-4554-85b9-541273bd8da3 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.035718] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.035718] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.035986] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.036151] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0bc29505-f5b4-4554-85b9-541273bd8da3',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.037110] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bc29505-f5b4-4554-85b9-541273bd8da3 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.037523] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.037523] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-24e2e8fa-0e01-42df-8a41-28d2438bbf41 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.037748] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24e2e8fa-0e01-42df-8a41-28d2438bbf41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.037748] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24e2e8fa-0e01-42df-8a41-28d2438bbf41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.037989] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24e2e8fa-0e01-42df-8a41-28d2438bbf41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.038168] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24e2e8fa-0e01-42df-8a41-28d2438bbf41',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.278798] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 in Status: SUCCESS [ 1014.278798] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 deletion is rescheduled due to dependency. [ 1014.278798] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.278798] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.278798] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.278798] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.278798] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.278798] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.278798] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.278798] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.278798] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bc29505-f5b4-4554-85b9-541273bd8da3',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.364705] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8ff5e5b-5797-4254-b957-602d11e125dd in Status: SUCCESS [ 1014.365148] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8ff5e5b-5797-4254-b957-602d11e125dd deletion is rescheduled due to dependency. [ 1014.365384] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8ff5e5b-5797-4254-b957-602d11e125dd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.365732] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 19617b8c-aea6-423c-b344-221d80fef4d7 [ 1014.366099] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.366390] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.366556] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.366835] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.367017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.367192] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:19617b8c-aea6-423c-b344-221d80fef4d7 already deleted. [ 1014.367365] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19617b8c-aea6-423c-b344-221d80fef4d7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.539920] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bc29505-f5b4-4554-85b9-541273bd8da3 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.540116] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.540323] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 24e2e8fa-0e01-42df-8a41-28d2438bbf41 with status ACTIVE [ 1014.540559] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.541070] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.541070] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.541070] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.541070] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.541302] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.541302] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.541302] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.541648] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.541648] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.541770] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.541770] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.541909] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.541968] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.542040] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.542576] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 24e2e8fa-0e01-42df-8a41-28d2438bbf41 is going to be updated. [ 1014.568967] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.569154] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.569228] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.569453] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.569568] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.569727] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24e2e8fa-0e01-42df-8a41-28d2438bbf41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.742032] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17f09989-f208-4cef-8aea-94e818aa9a91 in Status: SUCCESS [ 1014.742032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17f09989-f208-4cef-8aea-94e818aa9a91" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.742032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17f09989-f208-4cef-8aea-94e818aa9a91" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.742032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17f09989-f208-4cef-8aea-94e818aa9a91" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.742032] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.742032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.742032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.742032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.742032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.742032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17f09989-f208-4cef-8aea-94e818aa9a91" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.742032] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('17f09989-f208-4cef-8aea-94e818aa9a91',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.781076] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0bc29505-f5b4-4554-85b9-541273bd8da3',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.871112] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a in Status: SUCCESS [ 1014.871316] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a deletion is rescheduled due to dependency. [ 1014.871426] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.245106] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-17f09989-f208-4cef-8aea-94e818aa9a91 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.245313] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17f09989-f208-4cef-8aea-94e818aa9a91" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.245503] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17f09989-f208-4cef-8aea-94e818aa9a91" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.245720] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17f09989-f208-4cef-8aea-94e818aa9a91" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.245993] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.246187] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.246310] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.246594] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.246594] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.246763] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17f09989-f208-4cef-8aea-94e818aa9a91" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.246935] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-17f09989-f208-4cef-8aea-94e818aa9a91 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.247113] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17f09989-f208-4cef-8aea-94e818aa9a91" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.247244] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17f09989-f208-4cef-8aea-94e818aa9a91" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.247426] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17f09989-f208-4cef-8aea-94e818aa9a91" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.247607] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.247684] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.247721] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.247876] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.247953] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.248253] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17f09989-f208-4cef-8aea-94e818aa9a91" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.248392] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('17f09989-f208-4cef-8aea-94e818aa9a91',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.284994] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0bc29505-f5b4-4554-85b9-541273bd8da3',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.316924] env[69506]: INFO networking_nsxv3.common.synchronization [req-a368e31f-5a83-4de7-8b70-7c8ac85f9556 req-f30ff269-323c-4df1-838e-ca85d8b3b94b tempest-AttachInterfacesTestJSON-2055467997 tempest-AttachInterfacesTestJSON-2055467997-project-member] Enqueued Resource ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 with Priority: HIGHEST for action security_group_members [ 1015.318054] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 with Priority: HIGHEST for action security_group_members [ 1015.318890] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f946d66-543a-40be-9347-81d7eb4f4e31 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.318890] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.318890] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.318890] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.318890] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.319206] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.319206] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.319206] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.319355] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.319453] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.752282] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 17f09989-f208-4cef-8aea-94e818aa9a91: rpc.has_security_group_logging(os_id): False [ 1015.790295] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.790497] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.790725] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.791064] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.791430] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.791430] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 is going to be updated. [ 1015.794977] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 008501d4-938b-4336-9c1d-ef3665f7d09d in Status: SUCCESS [ 1015.796169] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.805205] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.805425] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.805563] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.806372] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.806372] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.806372] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.806656] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.806656] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.806934] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.806934] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.807229] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.807442] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.807641] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.807953] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.807953] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.808654] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.808654] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.808654] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.808899] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.808899] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.809313] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17f09989-f208-4cef-8aea-94e818aa9a91 is going to be created. [ 1015.823082] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.834590] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.834958] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.834958] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.835251] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.835957] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.848958] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 in Status: IN_PROGRESS for 2s [ 1015.873719] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.873909] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.874048] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.874223] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.874422] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.888344] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17f09989-f208-4cef-8aea-94e818aa9a91 in Status: IN_PROGRESS for 2s [ 1016.123210] env[69506]: INFO networking_nsxv3.common.synchronization [None req-cf88207b-b5be-4b90-96f3-ef2dff9164d8 None None] Enqueued Resource ID: 60de74ca-5efd-4fa8-af83-7df4f26400f0 with Priority: HIGHEST for action port [ 1016.125262] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60de74ca-5efd-4fa8-af83-7df4f26400f0 with Priority: HIGHEST for action port [ 1016.125262] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-60de74ca-5efd-4fa8-af83-7df4f26400f0 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.125262] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60de74ca-5efd-4fa8-af83-7df4f26400f0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.125262] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60de74ca-5efd-4fa8-af83-7df4f26400f0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.125262] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60de74ca-5efd-4fa8-af83-7df4f26400f0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.125262] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60de74ca-5efd-4fa8-af83-7df4f26400f0',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.325556] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.433163] env[69506]: INFO networking_nsxv3.common.synchronization [None req-03c7c279-13c1-4d90-bfb1-4fcc97caf271 tempest-AttachInterfacesTestJSON-2055467997 tempest-AttachInterfacesTestJSON-2055467997-project-member] Enqueued Resource ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 with Priority: HIGHEST for action security_group_members [ 1016.433163] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 with Priority: HIGHEST for action security_group_members [ 1016.433163] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f946d66-543a-40be-9347-81d7eb4f4e31 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.433818] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.628289] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 60de74ca-5efd-4fa8-af83-7df4f26400f0 [ 1016.628289] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.628289] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.628289] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.628289] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.628289] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.628289] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:60de74ca-5efd-4fa8-af83-7df4f26400f0 already deleted. [ 1016.628289] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60de74ca-5efd-4fa8-af83-7df4f26400f0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.830520] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.830520] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.830520] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.830520] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.830520] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.830520] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 is going to be updated. [ 1016.872026] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.872026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.872026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.872026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.872026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.887834] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 in Status: IN_PROGRESS for 2s [ 1017.164196] env[69506]: INFO networking_nsxv3.common.synchronization [req-8634fa33-a8cc-4562-9829-172c2ae00751 req-a750f0f0-f71d-463b-9dbb-7e766737b06f tempest-ListServersNegativeTestJSON-745882135 tempest-ListServersNegativeTestJSON-745882135-project-member] Enqueued Resource ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 with Priority: HIGHEST for action security_group_members [ 1017.164196] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 with Priority: HIGHEST for action security_group_members [ 1017.164196] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52cf5b6-2860-4667-8ade-9e0529358ed1 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.164196] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.164196] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.165601] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.165935] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.166217] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.166416] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.169136] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.169136] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.169136] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d52cf5b6-2860-4667-8ade-9e0529358ed1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.284151] env[69506]: INFO networking_nsxv3.common.synchronization [req-4ce1620c-b777-4434-9e29-02a9fba9f6bf req-d7817897-4797-4955-bf49-d1c788767908 tempest-ListServersNegativeTestJSON-745882135 tempest-ListServersNegativeTestJSON-745882135-project-member] Enqueued Resource ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 with Priority: HIGHEST for action security_group_members [ 1017.284151] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 with Priority: HIGHEST for action security_group_members [ 1017.284151] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52cf5b6-2860-4667-8ade-9e0529358ed1 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.285979] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.670541] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.670899] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.670899] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.671041] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.671144] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.671345] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.671481] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.671524] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.671666] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.671738] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.671822] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 is going to be updated. [ 1017.695840] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.696019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.696100] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.696302] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.696435] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.704297] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 in Status: IN_PROGRESS for 2s [ 1017.860968] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 in Status: SUCCESS [ 1017.861254] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.861403] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.861620] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.861863] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.861950] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.861985] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.862143] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.862224] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.862310] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.862399] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0bc29505-f5b4-4554-85b9-541273bd8da3',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.898594] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17f09989-f208-4cef-8aea-94e818aa9a91 in Status: SUCCESS [ 1017.898882] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17f09989-f208-4cef-8aea-94e818aa9a91" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.368997] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bc29505-f5b4-4554-85b9-541273bd8da3 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.369183] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.369249] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.369515] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.369703] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.369815] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.369873] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.370096] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.370199] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.370289] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.370484] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bc29505-f5b4-4554-85b9-541273bd8da3 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.370577] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.370632] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.370749] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.370901] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.371052] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.371052] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.371212] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.371289] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.371382] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.371485] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0bc29505-f5b4-4554-85b9-541273bd8da3',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.874194] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0bc29505-f5b4-4554-85b9-541273bd8da3: rpc.has_security_group_logging(os_id): False [ 1018.894292] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.894292] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.894292] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.894292] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.894292] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.894292] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.894292] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.894292] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.895039] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.895039] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.895039] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.895039] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.895039] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.895039] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.895039] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.895397] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.895397] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.895397] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.895639] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.895639] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.895740] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 is going to be updated. [ 1018.897364] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 in Status: SUCCESS [ 1018.897547] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.898288] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.898288] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.898445] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.898670] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.898670] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.898865] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.898865] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.898865] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.956604] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.956604] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.956604] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.956604] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.956892] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.972792] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 in Status: IN_PROGRESS for 2s [ 1019.342915] env[69506]: INFO networking_nsxv3.common.synchronization [req-7b43e253-6cb0-49c7-ae75-03e3712de732 req-e771a69b-0c86-4b5a-bd05-27005b62b26a tempest-ServersTestJSON-1801092994 tempest-ServersTestJSON-1801092994-project-member] Enqueued Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 1019.342915] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 1019.342915] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.343285] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.343760] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.343986] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.344181] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.344288] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.344344] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.344535] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.345372] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.345372] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.401749] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.402302] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.402921] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.409161] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.409161] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.409161] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.409161] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.409161] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.409161] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.409161] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.409161] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 is going to be updated. [ 1019.436343] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.436691] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.436691] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.436815] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.436929] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.444671] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 in Status: IN_PROGRESS for 2s [ 1019.715967] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 in Status: SUCCESS [ 1019.716336] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 deletion is rescheduled due to dependency. [ 1019.716458] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.716621] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.716830] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.717026] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.717149] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.717208] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.717370] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.717450] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.717639] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d52cf5b6-2860-4667-8ade-9e0529358ed1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.735290] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-54 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.735409] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-54" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.735521] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-54" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.735810] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-54" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.736939] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.736939] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.736939] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.736939] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.736939] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.737333] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1019.737333] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1019.737333] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1019.737453] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1019.737522] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1019.737627] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1019.737761] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1019.756468] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1019.757463] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1019.757750] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1019.758075] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-54" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.758530] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-ef76419e-4047-451e-a069-99df4ad1bd02 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.758788] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-ef76419e-4047-451e-a069-99df4ad1bd02" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.758968] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-ef76419e-4047-451e-a069-99df4ad1bd02" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.759462] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-ef76419e-4047-451e-a069-99df4ad1bd02" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.759803] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef76419e-4047-451e-a069-99df4ad1bd02',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.846256] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.200691] env[69506]: INFO networking_nsxv3.common.synchronization [req-bc24cc8c-04ba-4b9e-8b97-6351bbf9c085 req-8f4a34d0-1b12-4e88-8fc7-5890acb69207 tempest-AttachInterfacesTestJSON-2055467997 tempest-AttachInterfacesTestJSON-2055467997-project-member] Enqueued Resource ID: 2d66cc0b-bd33-47cb-9365-01d39638c887 with Priority: HIGHEST for action security_group_members [ 1020.201054] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d66cc0b-bd33-47cb-9365-01d39638c887 with Priority: HIGHEST for action security_group_members [ 1020.201276] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d66cc0b-bd33-47cb-9365-01d39638c887 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.201437] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d66cc0b-bd33-47cb-9365-01d39638c887" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.201521] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d66cc0b-bd33-47cb-9365-01d39638c887" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.202179] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d66cc0b-bd33-47cb-9365-01d39638c887" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.202179] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.202179] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.202179] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.202498] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.202498] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.202498] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d66cc0b-bd33-47cb-9365-01d39638c887',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.221618] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.221799] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.221855] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.222079] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.222201] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.222463] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.222547] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.222703] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.222814] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.222875] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.222993] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 is going to be updated. [ 1020.246863] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.247514] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.247514] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.247514] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.247514] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.260492] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 in Status: IN_PROGRESS for 2s [ 1020.265786] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.265786] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.265786] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.266186] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.266186] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.266278] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port ef76419e-4047-451e-a069-99df4ad1bd02 not found, creating... [ 1020.266544] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.266807] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.266924] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.267195] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.267360] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.267692] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.267869] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.268242] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.268516] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.268730] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.268954] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: ef76419e-4047-451e-a069-99df4ad1bd02 is going to be created. [ 1020.288142] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.288456] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.288616] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.288913] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.289197] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.289460] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-ef76419e-4047-451e-a069-99df4ad1bd02" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.349435] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.705931] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.705931] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.705931] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.705931] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.726146] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.726146] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.726146] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.726297] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.726401] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.726566] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.726566] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d66cc0b-bd33-47cb-9365-01d39638c887 is going to be updated. [ 1020.750909] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.751106] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.751106] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.751316] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.751453] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.759904] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d66cc0b-bd33-47cb-9365-01d39638c887 in Status: IN_PROGRESS for 2s [ 1020.804897] env[69506]: INFO networking_nsxv3.common.synchronization [req-d7a94d3c-c51c-4252-b0ce-132ef23f0c8d req-3d142c00-b097-476d-ba69-36ecdeb8d2a2 tempest-ServerDiskConfigTestJSON-583020681 tempest-ServerDiskConfigTestJSON-583020681-project-member] Enqueued Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_members [ 1020.805705] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGHEST for action security_group_members [ 1020.805937] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-008501d4-938b-4336-9c1d-ef3665f7d09d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.805937] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.806117] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.806254] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.806546] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.806546] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.806546] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.806900] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.806900] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.807075] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.853911] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.854046] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.854119] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.854960] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.854960] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.854960] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc is going to be updated. [ 1020.882347] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.882474] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.882558] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.882748] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.882890] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.890740] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: IN_PROGRESS for 2s [ 1020.976201] env[69506]: INFO networking_nsxv3.common.synchronization [req-7b43e253-6cb0-49c7-ae75-03e3712de732 req-60f17433-25a7-45cd-abd1-caf4be9b454c service nova] Enqueued Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_rules [ 1020.976201] env[69506]: INFO networking_nsxv3.common.synchronization [req-7b43e253-6cb0-49c7-ae75-03e3712de732 req-60f17433-25a7-45cd-abd1-caf4be9b454c service nova] Enqueued Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 1020.976201] env[69506]: INFO networking_nsxv3.common.synchronization [req-7b43e253-6cb0-49c7-ae75-03e3712de732 req-60f17433-25a7-45cd-abd1-caf4be9b454c service nova] Enqueued Resource ID: ef76419e-4047-451e-a069-99df4ad1bd02 with Priority: HIGHEST for action port [ 1020.976940] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_rules [ 1020.977206] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 1020.977457] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef76419e-4047-451e-a069-99df4ad1bd02 with Priority: HIGHEST for action port [ 1020.978730] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.978730] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.978730] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.978910] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.978948] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.981469] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.981469] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.981469] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef76419e-4047-451e-a069-99df4ad1bd02 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.981469] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef76419e-4047-451e-a069-99df4ad1bd02" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.981469] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef76419e-4047-451e-a069-99df4ad1bd02" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.981469] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef76419e-4047-451e-a069-99df4ad1bd02" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.981469] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef76419e-4047-451e-a069-99df4ad1bd02',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.988671] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 in Status: SUCCESS [ 1020.989019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.310079] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.310079] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.310079] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.310079] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.310079] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.310079] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.310079] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.310079] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.311033] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.311033] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.311033] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 008501d4-938b-4336-9c1d-ef3665f7d09d is going to be updated. [ 1021.335797] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.335981] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.335981] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.336166] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.336306] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.344777] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 008501d4-938b-4336-9c1d-ef3665f7d09d in Status: IN_PROGRESS for 2s [ 1021.455146] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 in Status: SUCCESS [ 1021.455379] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 deletion is rescheduled due to dependency. [ 1021.455516] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.482565] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.482749] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.484118] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ef76419e-4047-451e-a069-99df4ad1bd02 with status ACTIVE [ 1021.484543] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.484703] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.484795] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.485041] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.485258] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.485475] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.485605] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.485679] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.486736] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.486736] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.486855] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.486931] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.486973] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.489798] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.489798] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.489798] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ef76419e-4047-451e-a069-99df4ad1bd02 is going to be updated. [ 1021.516438] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.516585] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.516643] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.516850] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.516985] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.517179] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef76419e-4047-451e-a069-99df4ad1bd02" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.841135] env[69506]: INFO networking_nsxv3.common.synchronization [req-5de329de-82a0-42bd-917c-a315d87fec5b req-1b9204e6-ee0b-44cb-9e70-bd7e7a4595cc tempest-ServersTestFqdnHostnames-1516588989 tempest-ServersTestFqdnHostnames-1516588989-project-member] Enqueued Resource ID: eee25a0e-a423-45cd-80e8-327029ae7dc4 with Priority: HIGHEST for action security_group_members [ 1021.841135] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eee25a0e-a423-45cd-80e8-327029ae7dc4 with Priority: HIGHEST for action security_group_members [ 1021.841135] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-eee25a0e-a423-45cd-80e8-327029ae7dc4 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.841135] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eee25a0e-a423-45cd-80e8-327029ae7dc4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.841135] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eee25a0e-a423-45cd-80e8-327029ae7dc4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.841135] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eee25a0e-a423-45cd-80e8-327029ae7dc4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.841135] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.841135] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.841135] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.842162] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.842377] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.842565] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eee25a0e-a423-45cd-80e8-327029ae7dc4',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.267726] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 in Status: SUCCESS [ 1022.267933] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 deletion is rescheduled due to dependency. [ 1022.268061] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.324018] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-246 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.324355] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-246" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.324355] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-246" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.324724] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-246" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.325016] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.325194] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.325344] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.325533] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.325689] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.325901] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1022.326032] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1022.326153] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1022.326267] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1022.326379] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1022.326490] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1022.326627] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1022.343657] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1022.343820] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1022.343962] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1022.344181] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-246" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.344467] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-909a1ba8-7447-4b22-89ad-c89ab1db598f taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.344634] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-909a1ba8-7447-4b22-89ad-c89ab1db598f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.344758] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-909a1ba8-7447-4b22-89ad-c89ab1db598f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.345059] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-909a1ba8-7447-4b22-89ad-c89ab1db598f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.345209] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('909a1ba8-7447-4b22-89ad-c89ab1db598f',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.348698] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.348826] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.348899] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.349082] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.349173] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.349367] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.349490] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.349568] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.349719] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.349797] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.349887] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eee25a0e-a423-45cd-80e8-327029ae7dc4 already deleted. [ 1022.350013] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eee25a0e-a423-45cd-80e8-327029ae7dc4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.768647] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d66cc0b-bd33-47cb-9365-01d39638c887 in Status: SUCCESS [ 1022.768808] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d66cc0b-bd33-47cb-9365-01d39638c887 deletion is rescheduled due to dependency. [ 1022.768947] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d66cc0b-bd33-47cb-9365-01d39638c887" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.851417] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.851720] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.851720] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.851967] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.852145] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.852396] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 909a1ba8-7447-4b22-89ad-c89ab1db598f not found, creating... [ 1022.852687] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.852883] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.853158] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.853243] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.853424] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.853751] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.853997] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.854248] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.854384] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.855997] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.855997] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 909a1ba8-7447-4b22-89ad-c89ab1db598f is going to be created. [ 1022.874356] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.875023] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.875023] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.875806] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.875806] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.875806] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-909a1ba8-7447-4b22-89ad-c89ab1db598f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.905185] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: SUCCESS [ 1022.905758] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.907044] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.907044] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.907044] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.907044] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.907044] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.907432] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.907432] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.907432] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.354639] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 008501d4-938b-4336-9c1d-ef3665f7d09d in Status: SUCCESS [ 1023.355035] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 008501d4-938b-4336-9c1d-ef3665f7d09d deletion is rescheduled due to dependency. [ 1023.355035] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.410263] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.687312] env[69506]: INFO networking_nsxv3.common.synchronization [req-5de329de-82a0-42bd-917c-a315d87fec5b req-00fceb3d-9f25-4ffe-b3c7-96a666fd5382 service nova] Enqueued Resource ID: eee25a0e-a423-45cd-80e8-327029ae7dc4 with Priority: HIGHEST for action security_group_rules [ 1023.687312] env[69506]: INFO networking_nsxv3.common.synchronization [req-5de329de-82a0-42bd-917c-a315d87fec5b req-00fceb3d-9f25-4ffe-b3c7-96a666fd5382 service nova] Enqueued Resource ID: eee25a0e-a423-45cd-80e8-327029ae7dc4 with Priority: HIGHEST for action security_group_members [ 1023.687312] env[69506]: INFO networking_nsxv3.common.synchronization [req-5de329de-82a0-42bd-917c-a315d87fec5b req-00fceb3d-9f25-4ffe-b3c7-96a666fd5382 service nova] Enqueued Resource ID: 909a1ba8-7447-4b22-89ad-c89ab1db598f with Priority: HIGHEST for action port [ 1023.687312] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eee25a0e-a423-45cd-80e8-327029ae7dc4 with Priority: HIGHEST for action security_group_rules [ 1023.687312] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eee25a0e-a423-45cd-80e8-327029ae7dc4 with Priority: HIGHEST for action security_group_members [ 1023.687312] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 909a1ba8-7447-4b22-89ad-c89ab1db598f with Priority: HIGHEST for action port [ 1023.687312] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eee25a0e-a423-45cd-80e8-327029ae7dc4 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.687312] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eee25a0e-a423-45cd-80e8-327029ae7dc4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.687312] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eee25a0e-a423-45cd-80e8-327029ae7dc4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.688156] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eee25a0e-a423-45cd-80e8-327029ae7dc4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.688947] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eee25a0e-a423-45cd-80e8-327029ae7dc4',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.690051] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-eee25a0e-a423-45cd-80e8-327029ae7dc4 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.690478] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eee25a0e-a423-45cd-80e8-327029ae7dc4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.690478] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eee25a0e-a423-45cd-80e8-327029ae7dc4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.692164] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eee25a0e-a423-45cd-80e8-327029ae7dc4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.692164] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.692164] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.692164] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.692164] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.692164] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.692164] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eee25a0e-a423-45cd-80e8-327029ae7dc4',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.693170] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-909a1ba8-7447-4b22-89ad-c89ab1db598f taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.694025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-909a1ba8-7447-4b22-89ad-c89ab1db598f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.694025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-909a1ba8-7447-4b22-89ad-c89ab1db598f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.694779] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-909a1ba8-7447-4b22-89ad-c89ab1db598f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.694779] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('909a1ba8-7447-4b22-89ad-c89ab1db598f',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.914914] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.194894] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eee25a0e-a423-45cd-80e8-327029ae7dc4',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.196954] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 909a1ba8-7447-4b22-89ad-c89ab1db598f with status ACTIVE [ 1024.197257] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.197384] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.197734] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.197823] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.197862] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.198186] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.198320] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.198396] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.198508] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.198578] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.198910] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.199061] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.199121] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.199410] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.199410] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.199509] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 909a1ba8-7447-4b22-89ad-c89ab1db598f is going to be updated. [ 1024.200769] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-eee25a0e-a423-45cd-80e8-327029ae7dc4 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.200902] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eee25a0e-a423-45cd-80e8-327029ae7dc4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.223163] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.223163] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.223163] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.223163] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.223163] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.223163] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-909a1ba8-7447-4b22-89ad-c89ab1db598f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.417057] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.417057] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.417498] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.417498] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.417498] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.417806] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc is going to be updated. [ 1024.446665] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.446832] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.446910] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.447264] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.447437] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.459798] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: IN_PROGRESS for 2s [ 1024.696038] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eee25a0e-a423-45cd-80e8-327029ae7dc4',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.199281] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.199531] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.199677] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.199910] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.200078] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.200201] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eee25a0e-a423-45cd-80e8-327029ae7dc4 is going to be created. [ 1025.226966] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.226966] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.226966] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.227396] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.227396] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.236690] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eee25a0e-a423-45cd-80e8-327029ae7dc4 in Status: UNINITIALIZED for 2s [ 1026.469900] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: SUCCESS [ 1026.470249] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.470326] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.470589] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.470857] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.471032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.471113] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.471279] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.471365] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.471454] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.471548] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.973700] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.973890] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.973974] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.974272] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.974484] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.974633] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.974704] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.974857] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.974944] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.975047] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.975203] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.975298] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.975359] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.975500] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.975635] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.975725] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.975784] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.975994] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.976074] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.976160] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.976263] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.247672] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eee25a0e-a423-45cd-80e8-327029ae7dc4 in Status: SUCCESS [ 1027.247816] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eee25a0e-a423-45cd-80e8-327029ae7dc4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.247949] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eee25a0e-a423-45cd-80e8-327029ae7dc4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.248284] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eee25a0e-a423-45cd-80e8-327029ae7dc4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.252018] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.252018] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.252018] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.252018] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.252018] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.252018] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eee25a0e-a423-45cd-80e8-327029ae7dc4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.252018] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eee25a0e-a423-45cd-80e8-327029ae7dc4',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.478538] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc: rpc.has_security_group_logging(os_id): False [ 1027.501832] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.501832] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.501832] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.501832] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.501832] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.501832] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.501832] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.501832] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.501832] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.501832] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.501832] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.501832] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.501832] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.501832] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.502377] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.502377] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.502377] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.502377] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.502377] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.502559] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.502559] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc is going to be updated. [ 1027.564188] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.564188] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.564188] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.564188] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.564188] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.578339] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: IN_PROGRESS for 2s [ 1027.753630] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eee25a0e-a423-45cd-80e8-327029ae7dc4',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.983242] env[69506]: INFO networking_nsxv3.common.synchronization [req-13115add-6659-4d5e-aa59-c49af1d319e4 req-f242e72a-baf9-43c4-8e99-29160b90a88f tempest-InstanceActionsTestJSON-587208907 tempest-InstanceActionsTestJSON-587208907-project-member] Enqueued Resource ID: 17f09989-f208-4cef-8aea-94e818aa9a91 with Priority: HIGHEST for action security_group_members [ 1027.983768] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17f09989-f208-4cef-8aea-94e818aa9a91 with Priority: HIGHEST for action security_group_members [ 1027.984413] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-17f09989-f208-4cef-8aea-94e818aa9a91 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.984544] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17f09989-f208-4cef-8aea-94e818aa9a91" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.984618] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17f09989-f208-4cef-8aea-94e818aa9a91" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.984834] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17f09989-f208-4cef-8aea-94e818aa9a91" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.984984] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.985098] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.985149] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.985284] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.985370] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.985458] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17f09989-f208-4cef-8aea-94e818aa9a91',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.256169] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eee25a0e-a423-45cd-80e8-327029ae7dc4: rpc.has_security_group_logging(os_id): False [ 1028.273673] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.273673] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.273673] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.273673] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.273673] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.274082] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.274082] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.274082] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.274209] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.274251] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.274356] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eee25a0e-a423-45cd-80e8-327029ae7dc4 is going to be created. [ 1028.345010] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.345010] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.345010] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.345010] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.345010] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.353828] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eee25a0e-a423-45cd-80e8-327029ae7dc4 in Status: IN_PROGRESS for 2s [ 1028.488083] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.488372] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.488372] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.488542] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.488633] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.489855] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.489855] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.489855] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.489855] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.490187] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.490187] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17f09989-f208-4cef-8aea-94e818aa9a91 is going to be updated. [ 1028.523874] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.524037] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.524110] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.524317] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.524448] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.538297] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17f09989-f208-4cef-8aea-94e818aa9a91 in Status: IN_PROGRESS for 2s [ 1029.592330] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: SUCCESS [ 1029.592640] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.366931] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eee25a0e-a423-45cd-80e8-327029ae7dc4 in Status: SUCCESS [ 1030.367410] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eee25a0e-a423-45cd-80e8-327029ae7dc4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.549465] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17f09989-f208-4cef-8aea-94e818aa9a91 in Status: SUCCESS [ 1030.549658] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17f09989-f208-4cef-8aea-94e818aa9a91 deletion is rescheduled due to dependency. [ 1030.549789] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17f09989-f208-4cef-8aea-94e818aa9a91" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.022019] env[69506]: INFO networking_nsxv3.common.synchronization [req-9735caf3-5b10-4853-8d3c-ff477db1631e req-5daa6200-8579-4d4f-b09c-ff75319cadf7 tempest-ServerActionsTestJSON-78405165 tempest-ServerActionsTestJSON-78405165-project-member] Enqueued Resource ID: c141011f-1c58-45cb-b73c-ad882255b77a with Priority: HIGHEST for action security_group_members [ 1032.022300] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c141011f-1c58-45cb-b73c-ad882255b77a with Priority: HIGHEST for action security_group_members [ 1032.022938] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-c141011f-1c58-45cb-b73c-ad882255b77a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.022938] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c141011f-1c58-45cb-b73c-ad882255b77a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.022938] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c141011f-1c58-45cb-b73c-ad882255b77a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.023167] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c141011f-1c58-45cb-b73c-ad882255b77a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.023283] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.023382] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.023440] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.023589] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.023674] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.023767] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c141011f-1c58-45cb-b73c-ad882255b77a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.377975] env[69506]: INFO networking_nsxv3.common.synchronization [req-71b24143-6235-4e40-95ec-eb03c1b67c85 req-0c3e6358-c33c-40df-afc2-b202bd809bb9 tempest-ServersTestJSON-1801092994 tempest-ServersTestJSON-1801092994-project-member] Enqueued Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 1032.379188] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 1032.379906] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.380079] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.380171] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.380383] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.380546] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.380647] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.380706] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.380854] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.380939] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.381124] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.463795] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-656 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.463999] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-656" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.464142] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-656" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.464419] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-656" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.465246] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.465365] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.465468] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.465662] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.465814] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.466056] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1032.466184] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1032.466297] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1032.466422] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1032.466778] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1032.466778] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1032.466778] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1032.484046] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1032.484046] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1032.484195] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1032.484334] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-656" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.484611] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-b79f4cda-592f-4f84-b8c9-6ebc096e3553 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.484777] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-b79f4cda-592f-4f84-b8c9-6ebc096e3553" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.484905] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-b79f4cda-592f-4f84-b8c9-6ebc096e3553" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.485214] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-b79f4cda-592f-4f84-b8c9-6ebc096e3553" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.485356] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b79f4cda-592f-4f84-b8c9-6ebc096e3553',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.527561] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.527723] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.527796] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.528109] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.528233] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.528461] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.528598] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.528674] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.528835] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.528915] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.529027] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c141011f-1c58-45cb-b73c-ad882255b77a already deleted. [ 1032.529115] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c141011f-1c58-45cb-b73c-ad882255b77a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.883415] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.988689] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.988863] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.989117] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.989475] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.989699] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.989873] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port b79f4cda-592f-4f84-b8c9-6ebc096e3553 not found, creating... [ 1032.990259] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.990459] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.990611] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.990889] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.991078] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.991403] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.991591] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.991721] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.991948] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.992112] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.993173] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: b79f4cda-592f-4f84-b8c9-6ebc096e3553 is going to be created. [ 1033.011983] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.012237] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.012393] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.012708] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.012942] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.013216] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-b79f4cda-592f-4f84-b8c9-6ebc096e3553" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.385571] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.688293] env[69506]: INFO networking_nsxv3.common.synchronization [req-9735caf3-5b10-4853-8d3c-ff477db1631e req-73450344-5fe3-4b61-9bbb-9d59d9bc50df service nova] Enqueued Resource ID: c141011f-1c58-45cb-b73c-ad882255b77a with Priority: HIGHEST for action security_group_rules [ 1033.688470] env[69506]: INFO networking_nsxv3.common.synchronization [req-9735caf3-5b10-4853-8d3c-ff477db1631e req-73450344-5fe3-4b61-9bbb-9d59d9bc50df service nova] Enqueued Resource ID: c141011f-1c58-45cb-b73c-ad882255b77a with Priority: HIGHEST for action security_group_members [ 1033.690270] env[69506]: INFO networking_nsxv3.common.synchronization [req-9735caf3-5b10-4853-8d3c-ff477db1631e req-73450344-5fe3-4b61-9bbb-9d59d9bc50df service nova] Enqueued Resource ID: b79f4cda-592f-4f84-b8c9-6ebc096e3553 with Priority: HIGHEST for action port [ 1033.690270] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c141011f-1c58-45cb-b73c-ad882255b77a with Priority: HIGHEST for action security_group_rules [ 1033.690270] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c141011f-1c58-45cb-b73c-ad882255b77a with Priority: HIGHEST for action security_group_members [ 1033.690270] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b79f4cda-592f-4f84-b8c9-6ebc096e3553 with Priority: HIGHEST for action port [ 1033.690677] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c141011f-1c58-45cb-b73c-ad882255b77a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.692198] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c141011f-1c58-45cb-b73c-ad882255b77a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.692283] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c141011f-1c58-45cb-b73c-ad882255b77a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.692479] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c141011f-1c58-45cb-b73c-ad882255b77a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.692559] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c141011f-1c58-45cb-b73c-ad882255b77a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.693406] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-c141011f-1c58-45cb-b73c-ad882255b77a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.693519] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c141011f-1c58-45cb-b73c-ad882255b77a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.693718] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c141011f-1c58-45cb-b73c-ad882255b77a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.693789] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c141011f-1c58-45cb-b73c-ad882255b77a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.693938] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.694047] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.694115] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.694296] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.694387] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.694478] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c141011f-1c58-45cb-b73c-ad882255b77a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.695273] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-b79f4cda-592f-4f84-b8c9-6ebc096e3553 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.695384] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b79f4cda-592f-4f84-b8c9-6ebc096e3553" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.695453] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b79f4cda-592f-4f84-b8c9-6ebc096e3553" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.695604] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b79f4cda-592f-4f84-b8c9-6ebc096e3553" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.695681] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b79f4cda-592f-4f84-b8c9-6ebc096e3553',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.889077] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.889077] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.889077] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.889308] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.889308] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.889402] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc is going to be updated. [ 1033.915682] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.915812] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.915857] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.916042] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.916178] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.923935] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: IN_PROGRESS for 2s [ 1034.198667] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b79f4cda-592f-4f84-b8c9-6ebc096e3553 with status ACTIVE [ 1034.198893] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.199780] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.199780] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.199780] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.199780] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.199780] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.199780] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.199780] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.200185] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.200185] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.200253] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.200494] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.200494] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.200592] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.200592] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.200740] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b79f4cda-592f-4f84-b8c9-6ebc096e3553 is going to be updated. [ 1034.202746] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-c141011f-1c58-45cb-b73c-ad882255b77a taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.202746] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c141011f-1c58-45cb-b73c-ad882255b77a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.202746] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c141011f-1c58-45cb-b73c-ad882255b77a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.222879] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.223075] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.223125] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.223487] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.223487] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.223595] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b79f4cda-592f-4f84-b8c9-6ebc096e3553" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.343279] env[69506]: INFO networking_nsxv3.common.synchronization [req-8e54c202-b695-43b5-8403-4b9a90260e40 req-e85a2b2f-951c-4943-aeeb-3d57d91a63cd tempest-ImagesOneServerNegativeTestJSON-1660335094 tempest-ImagesOneServerNegativeTestJSON-1660335094-project-member] Enqueued Resource ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 with Priority: HIGHEST for action security_group_members [ 1034.343769] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 with Priority: HIGHEST for action security_group_members [ 1034.344605] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bc29505-f5b4-4554-85b9-541273bd8da3 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.344605] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.344605] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.344605] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.344605] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.344898] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.344898] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.344898] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.345030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.345386] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bc29505-f5b4-4554-85b9-541273bd8da3',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.479467] env[69506]: INFO networking_nsxv3.common.synchronization [req-da0a64e9-12c5-483a-8230-7dfb21948381 req-0b490e9b-d4ba-4799-ab27-3890d7a0f3c2 tempest-DeleteServersTestJSON-1880805458 tempest-DeleteServersTestJSON-1880805458-project-member] Enqueued Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_members [ 1034.480063] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_members [ 1034.480372] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.480501] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.480568] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.480808] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.480959] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.481060] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.481132] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.481279] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.481371] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.481449] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.704858] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c141011f-1c58-45cb-b73c-ad882255b77a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.832047] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-628 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.832245] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-628" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.833987] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-628" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.833987] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-628" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.833987] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.833987] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.833987] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.833987] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.833987] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.833987] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1034.834956] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1034.834956] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1034.834956] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1034.834956] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1034.834956] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1034.834956] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1034.849211] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.849211] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.849211] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.849211] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.849211] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.849211] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.849211] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.849211] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.849211] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.849211] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.849211] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 is going to be updated. [ 1034.851653] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1034.851653] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1034.851791] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1034.851954] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-628" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.852263] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-fdb9717b-6dce-4925-9ab1-14ccbc6628db taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.852431] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-fdb9717b-6dce-4925-9ab1-14ccbc6628db" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.852626] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-fdb9717b-6dce-4925-9ab1-14ccbc6628db" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.853121] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-fdb9717b-6dce-4925-9ab1-14ccbc6628db" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.853121] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fdb9717b-6dce-4925-9ab1-14ccbc6628db',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.872106] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.872266] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.872342] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.872596] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.872736] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.882695] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 in Status: IN_PROGRESS for 2s [ 1034.985350] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.985577] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.985577] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.985774] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.985871] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.986088] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.986178] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.986234] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.986491] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.986569] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.986658] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d already deleted. [ 1034.986760] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.207100] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.207374] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.207374] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.207556] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.207649] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.207754] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c141011f-1c58-45cb-b73c-ad882255b77a is going to be created. [ 1035.234950] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.235175] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.235237] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.235428] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.235605] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.245606] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c141011f-1c58-45cb-b73c-ad882255b77a in Status: UNINITIALIZED for 2s [ 1035.356020] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.356273] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.356408] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.356701] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.356858] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.357031] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port fdb9717b-6dce-4925-9ab1-14ccbc6628db not found, creating... [ 1035.357302] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.357461] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.357582] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.357801] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.357945] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.358259] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.358414] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.358535] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.358749] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.358890] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.359046] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: fdb9717b-6dce-4925-9ab1-14ccbc6628db is going to be created. [ 1035.379039] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.379039] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.379039] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.379039] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.379039] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.379327] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-fdb9717b-6dce-4925-9ab1-14ccbc6628db" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.932955] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: SUCCESS [ 1035.933211] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.067153] env[69506]: INFO networking_nsxv3.common.synchronization [req-da0a64e9-12c5-483a-8230-7dfb21948381 req-f5bb0324-98d7-47fd-9df2-c9317accc975 service nova] Enqueued Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_rules [ 1036.067381] env[69506]: INFO networking_nsxv3.common.synchronization [req-da0a64e9-12c5-483a-8230-7dfb21948381 req-f5bb0324-98d7-47fd-9df2-c9317accc975 service nova] Enqueued Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_members [ 1036.067548] env[69506]: INFO networking_nsxv3.common.synchronization [req-da0a64e9-12c5-483a-8230-7dfb21948381 req-f5bb0324-98d7-47fd-9df2-c9317accc975 service nova] Enqueued Resource ID: fdb9717b-6dce-4925-9ab1-14ccbc6628db with Priority: HIGHEST for action port [ 1036.068188] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_rules [ 1036.068249] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_members [ 1036.068348] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdb9717b-6dce-4925-9ab1-14ccbc6628db with Priority: HIGHEST for action port [ 1036.068640] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.068770] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.068846] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.072308] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.072308] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.072742] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.072878] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.072944] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.073180] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.073359] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.073466] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.073532] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.073712] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.073814] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.073924] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.074723] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-fdb9717b-6dce-4925-9ab1-14ccbc6628db taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.074858] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fdb9717b-6dce-4925-9ab1-14ccbc6628db" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.074928] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fdb9717b-6dce-4925-9ab1-14ccbc6628db" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.075054] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fdb9717b-6dce-4925-9ab1-14ccbc6628db" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.075130] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fdb9717b-6dce-4925-9ab1-14ccbc6628db',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.577586] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.577898] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.577958] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fdb9717b-6dce-4925-9ab1-14ccbc6628db with status ACTIVE [ 1036.578161] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.578231] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.578281] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.578477] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.578568] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.581071] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.581071] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.581071] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.581071] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.581071] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.581071] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.581071] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.581071] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.581071] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.581071] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.581071] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fdb9717b-6dce-4925-9ab1-14ccbc6628db is going to be updated. [ 1036.581071] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.610312] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.610425] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.610425] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.610625] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.610750] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.610895] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fdb9717b-6dce-4925-9ab1-14ccbc6628db" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.892248] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 in Status: SUCCESS [ 1036.892311] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 deletion is rescheduled due to dependency. [ 1036.892434] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.085577] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.255400] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c141011f-1c58-45cb-b73c-ad882255b77a in Status: SUCCESS [ 1037.255673] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c141011f-1c58-45cb-b73c-ad882255b77a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.255838] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c141011f-1c58-45cb-b73c-ad882255b77a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.256177] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c141011f-1c58-45cb-b73c-ad882255b77a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.256243] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.256347] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.256404] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.256523] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.256627] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.256682] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c141011f-1c58-45cb-b73c-ad882255b77a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.256765] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c141011f-1c58-45cb-b73c-ad882255b77a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.588381] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.588551] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.588662] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.588838] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.588921] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.589045] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d is going to be created. [ 1037.613661] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.613802] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.613903] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.614095] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.614253] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.623067] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: UNINITIALIZED for 2s [ 1037.760229] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c141011f-1c58-45cb-b73c-ad882255b77a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.264037] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c141011f-1c58-45cb-b73c-ad882255b77a: rpc.has_security_group_logging(os_id): False [ 1038.279275] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.279434] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.279540] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.279791] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.279903] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.280255] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.280393] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.280480] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.280640] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.280713] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.280799] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c141011f-1c58-45cb-b73c-ad882255b77a is going to be created. [ 1038.337748] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.337906] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.337963] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.338238] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.338432] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.348343] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c141011f-1c58-45cb-b73c-ad882255b77a in Status: IN_PROGRESS for 2s [ 1039.634327] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: SUCCESS [ 1039.634327] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.634618] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.634723] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.634923] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.635055] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.635122] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.635449] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.635449] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.635449] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.635598] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.139061] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.139061] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.139061] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.139297] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.139355] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.139456] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.139523] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.139671] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.139758] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.139842] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.139989] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.140178] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.140281] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.140347] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.140481] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.140570] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.140627] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.140759] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.140837] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.140915] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.141010] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.360534] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c141011f-1c58-45cb-b73c-ad882255b77a in Status: SUCCESS [ 1040.360534] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c141011f-1c58-45cb-b73c-ad882255b77a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.643444] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d: rpc.has_security_group_logging(os_id): False [ 1040.663210] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.663362] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.663485] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.663643] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.663736] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.664226] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.664226] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.664226] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.664398] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.664398] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.664565] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.664661] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.664722] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.664863] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.664940] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.665137] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.665233] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.665295] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.665435] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.665510] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.665597] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d is going to be created. [ 1040.720835] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.720993] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.721104] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.721335] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.721522] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.732012] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: IN_PROGRESS for 2s [ 1041.069475] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1041.069691] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1041.662595] env[69506]: INFO networking_nsxv3.common.synchronization [req-69d1e159-3435-413b-a173-5f26a93dbc5a req-63db2796-1244-4d58-aa6e-1995df7f8078 tempest-ServerPasswordTestJSON-1959743883 tempest-ServerPasswordTestJSON-1959743883-project-member] Enqueued Resource ID: 38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d with Priority: HIGHEST for action security_group_members [ 1041.663103] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d with Priority: HIGHEST for action security_group_members [ 1041.663409] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.663531] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.664257] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.664369] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.664538] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.664776] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.664776] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.664882] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.664955] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.665052] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.009700] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-362 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.009903] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-362" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.010048] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-362" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.010464] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-362" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.010861] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.011028] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.011028] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.011395] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.011472] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.014400] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1042.014400] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1042.014400] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1042.014400] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1042.014400] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1042.014400] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1042.014400] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1042.051022] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1042.051022] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1042.051022] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1042.051022] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-362" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.051022] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-374093ff-19c6-4a2f-b418-54fb2d9eecef taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.051022] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-374093ff-19c6-4a2f-b418-54fb2d9eecef" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.051022] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-374093ff-19c6-4a2f-b418-54fb2d9eecef" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.051022] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-374093ff-19c6-4a2f-b418-54fb2d9eecef" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.051022] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('374093ff-19c6-4a2f-b418-54fb2d9eecef',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.169904] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.169904] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.169904] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.169904] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.169904] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.169904] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.169904] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.169904] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.169904] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.169904] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.169904] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d already deleted. [ 1042.169904] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.553990] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.554252] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.554387] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.554694] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.554827] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.554991] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 374093ff-19c6-4a2f-b418-54fb2d9eecef not found, creating... [ 1042.555277] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.555457] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.555643] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.555882] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.555927] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.556204] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.556366] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.556487] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.556858] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.556858] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.556962] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 374093ff-19c6-4a2f-b418-54fb2d9eecef is going to be created. [ 1042.577462] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.577696] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.577829] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.578138] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.578366] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.578593] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-374093ff-19c6-4a2f-b418-54fb2d9eecef" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.747036] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: SUCCESS [ 1042.747333] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.512357] env[69506]: INFO networking_nsxv3.common.synchronization [req-69d1e159-3435-413b-a173-5f26a93dbc5a req-63f8f1be-6ce2-49c6-943e-11d74450e2d5 service nova] Enqueued Resource ID: 38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d with Priority: HIGHEST for action security_group_rules [ 1043.512551] env[69506]: INFO networking_nsxv3.common.synchronization [req-69d1e159-3435-413b-a173-5f26a93dbc5a req-63f8f1be-6ce2-49c6-943e-11d74450e2d5 service nova] Enqueued Resource ID: 38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d with Priority: HIGHEST for action security_group_members [ 1043.512733] env[69506]: INFO networking_nsxv3.common.synchronization [req-69d1e159-3435-413b-a173-5f26a93dbc5a req-63f8f1be-6ce2-49c6-943e-11d74450e2d5 service nova] Enqueued Resource ID: 374093ff-19c6-4a2f-b418-54fb2d9eecef with Priority: HIGHEST for action port [ 1043.513282] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d with Priority: HIGHEST for action security_group_rules [ 1043.513422] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d with Priority: HIGHEST for action security_group_members [ 1043.513515] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 374093ff-19c6-4a2f-b418-54fb2d9eecef with Priority: HIGHEST for action port [ 1043.513789] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.513912] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.513978] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.514253] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.514339] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.515838] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.515838] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.515838] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.515838] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.516058] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.516058] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.516058] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.516210] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.516252] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.516308] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.519069] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-374093ff-19c6-4a2f-b418-54fb2d9eecef taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.519069] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-374093ff-19c6-4a2f-b418-54fb2d9eecef" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.519409] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-374093ff-19c6-4a2f-b418-54fb2d9eecef" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.519409] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-374093ff-19c6-4a2f-b418-54fb2d9eecef" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.519409] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('374093ff-19c6-4a2f-b418-54fb2d9eecef',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.019210] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.024407] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 374093ff-19c6-4a2f-b418-54fb2d9eecef with status ACTIVE [ 1044.024645] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.024781] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.024949] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.025078] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.025166] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.025355] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.025447] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.025508] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.025665] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.025737] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.025948] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.026059] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.026123] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.026320] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.026412] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.026501] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 374093ff-19c6-4a2f-b418-54fb2d9eecef is going to be updated. [ 1044.027662] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.027823] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.056554] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.056717] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.056717] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.057095] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.057281] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.057452] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-374093ff-19c6-4a2f-b418-54fb2d9eecef" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.422938] env[69506]: INFO networking_nsxv3.common.synchronization [None req-70b43131-76d5-45e9-be7b-14aa28418e13 tempest-AttachInterfacesTestJSON-2055467997 tempest-AttachInterfacesTestJSON-2055467997-project-member] Enqueued Resource ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 with Priority: HIGHEST for action security_group_rules [ 1044.422938] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 with Priority: HIGHEST for action security_group_rules [ 1044.422938] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.422938] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.422938] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.422938] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.423347] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d9ed455-9c3f-46b7-9453-8a5f9cfb0580',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.525122] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.533311] env[69506]: INFO networking_nsxv3.common.synchronization [None req-9597d15e-57e2-430e-b39f-39f08c6a1c51 tempest-AttachInterfacesTestJSON-2055467997 tempest-AttachInterfacesTestJSON-2055467997-project-member] Enqueued Resource ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 with Priority: HIGHEST for action security_group_rules [ 1044.533837] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 with Priority: HIGHEST for action security_group_rules [ 1044.534158] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.534276] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.950254] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.950468] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.950533] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.951265] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.951265] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.951265] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 already deleted. [ 1044.951265] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.951265] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.951557] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.951557] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d9ed455-9c3f-46b7-9453-8a5f9cfb0580',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.030834] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.031214] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.031214] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.031350] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.031410] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.031526] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d is going to be created. [ 1045.055487] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.055661] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.055709] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.055882] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.056053] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.065029] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d in Status: UNINITIALIZED for 2s [ 1045.476223] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.476478] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.476478] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.476653] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.476746] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.476842] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 already deleted. [ 1045.476923] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.694307] env[69506]: INFO networking_nsxv3.common.synchronization [req-8f731cae-9391-4de8-b840-cc739f04693d req-189f5b1f-d8ea-4a4a-b168-c2b35a3b98bc tempest-ServersTestMultiNic-1599747181 tempest-ServersTestMultiNic-1599747181-project-member] Enqueued Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_members [ 1046.694827] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_members [ 1046.695141] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbe38da-467a-45a1-9704-6b9d3f78430a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.695290] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.695361] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.695552] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.695702] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.695799] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.695861] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.696617] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.696731] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.696828] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.076046] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d in Status: SUCCESS [ 1047.076277] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.076446] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.076675] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.076876] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.076992] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.077094] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.077259] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.077336] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.077423] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.077514] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.105296] env[69506]: INFO networking_nsxv3.common.synchronization [req-8f731cae-9391-4de8-b840-cc739f04693d req-9efc007b-c3c1-4414-86b1-1278689d4546 tempest-ServersTestMultiNic-1599747181 tempest-ServersTestMultiNic-1599747181-project-member] Enqueued Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_members [ 1047.105955] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_members [ 1047.106380] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbe38da-467a-45a1-9704-6b9d3f78430a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.106512] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.199139] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.199228] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.199302] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.199530] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.199625] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.199821] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.199922] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.199984] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.200181] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.200261] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.200348] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a is going to be updated. [ 1047.230625] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.230625] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.230625] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.230625] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.230886] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.239952] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a in Status: IN_PROGRESS for 2s [ 1047.583281] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.583497] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.583592] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.583871] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.584103] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.584240] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.584322] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.584632] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.584632] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.584769] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.584965] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.585097] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.585168] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.585344] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.585499] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.585759] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.585759] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.585877] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.588028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.588190] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.588353] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.641723] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-735 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.641969] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-735" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.642293] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-735" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.642458] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-735" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.642730] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.642894] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.643046] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.643344] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.643606] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.643854] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1047.643854] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1047.644027] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1047.644094] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1047.644159] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1047.644333] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1047.644399] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1047.663790] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1047.663982] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1047.664152] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1047.664351] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-735" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.664779] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-e409ab6b-b053-44dc-974a-cb59ef376a42 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.664896] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-e409ab6b-b053-44dc-974a-cb59ef376a42" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.664976] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-e409ab6b-b053-44dc-974a-cb59ef376a42" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.665330] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-e409ab6b-b053-44dc-974a-cb59ef376a42" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.665480] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e409ab6b-b053-44dc-974a-cb59ef376a42',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.954688] env[69506]: INFO networking_nsxv3.common.synchronization [req-167ccd2a-9785-4f6a-af42-fcf5c5b6ea9b req-0c5710c5-118b-4504-9797-b9a3dd0e77d8 tempest-DeleteServersTestJSON-1880805458 tempest-DeleteServersTestJSON-1880805458-project-member] Enqueued Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_members [ 1047.954688] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_members [ 1047.954688] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.954688] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.956049] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.956829] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.957417] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.960907] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.960907] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.960907] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.960907] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.960907] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.094349] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d: rpc.has_security_group_logging(os_id): False [ 1048.111288] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.111461] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.111527] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.111725] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.111815] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.112017] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.112117] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.112202] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.112364] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.112484] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.112637] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.112726] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.112788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.112928] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.113013] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.113217] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.113321] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.113377] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.113507] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.113580] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.113664] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d is going to be created. [ 1048.168078] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.168758] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.168758] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.168758] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.168942] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.168984] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port e409ab6b-b053-44dc-974a-cb59ef376a42 not found, creating... [ 1048.169337] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.169441] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.169544] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.169764] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.169907] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.170267] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.170434] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.170560] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.171026] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.171026] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.171129] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: e409ab6b-b053-44dc-974a-cb59ef376a42 is going to be created. [ 1048.182970] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.183206] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.183206] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.183358] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.183527] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.201722] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d in Status: IN_PROGRESS for 2s [ 1048.207537] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.207669] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.207782] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.208071] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.208322] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.208549] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-e409ab6b-b053-44dc-974a-cb59ef376a42" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.463916] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.464144] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.464144] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.464372] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.464460] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.464655] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.464754] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.464820] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.464969] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.465060] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.465149] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d is going to be updated. [ 1048.489906] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.490083] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.490337] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.490633] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.490791] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.498464] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: IN_PROGRESS for 2s [ 1048.920697] env[69506]: INFO networking_nsxv3.common.synchronization [req-8f731cae-9391-4de8-b840-cc739f04693d req-44039cd0-1dcf-4f75-bb85-29404880c94d service nova] Enqueued Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_rules [ 1048.920977] env[69506]: INFO networking_nsxv3.common.synchronization [req-8f731cae-9391-4de8-b840-cc739f04693d req-44039cd0-1dcf-4f75-bb85-29404880c94d service nova] Enqueued Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_members [ 1048.921185] env[69506]: INFO networking_nsxv3.common.synchronization [req-8f731cae-9391-4de8-b840-cc739f04693d req-44039cd0-1dcf-4f75-bb85-29404880c94d service nova] Enqueued Resource ID: e409ab6b-b053-44dc-974a-cb59ef376a42 with Priority: HIGHEST for action port [ 1048.921734] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_rules [ 1048.921940] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_members [ 1048.921995] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e409ab6b-b053-44dc-974a-cb59ef376a42 with Priority: HIGHEST for action port [ 1048.922431] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2dbe38da-467a-45a1-9704-6b9d3f78430a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.922554] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.922621] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.922823] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.922902] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.923758] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbe38da-467a-45a1-9704-6b9d3f78430a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.923886] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.924145] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-e409ab6b-b053-44dc-974a-cb59ef376a42 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.924279] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e409ab6b-b053-44dc-974a-cb59ef376a42" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.924361] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e409ab6b-b053-44dc-974a-cb59ef376a42" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.924544] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e409ab6b-b053-44dc-974a-cb59ef376a42" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.924627] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e409ab6b-b053-44dc-974a-cb59ef376a42',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.249301] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a in Status: SUCCESS [ 1049.249592] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a deletion is rescheduled due to dependency. [ 1049.249644] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.249769] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.249976] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.250204] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.250332] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.250391] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.250558] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.250640] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.250734] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.427148] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbe38da-467a-45a1-9704-6b9d3f78430a taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.427309] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.427496] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e409ab6b-b053-44dc-974a-cb59ef376a42 with status ACTIVE [ 1049.427668] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.427827] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.427827] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.428061] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.428149] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.428324] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.428469] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.428511] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.428628] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.428703] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.428885] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.428979] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.429047] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.429190] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.429311] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.429355] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e409ab6b-b053-44dc-974a-cb59ef376a42 is going to be updated. [ 1049.449524] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.449645] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.449723] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.449878] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.449999] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.450192] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e409ab6b-b053-44dc-974a-cb59ef376a42" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.720750] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-253 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.720990] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-253" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.721197] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-253" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.721550] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-253" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.721847] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.722062] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.722223] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.722508] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.722723] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.722967] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1049.723138] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1049.723317] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1049.723468] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1049.723619] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1049.723765] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1049.723935] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1049.740430] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1049.740584] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1049.740724] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1049.740895] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-253" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.741259] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-d0a4977e-c014-4f9c-803e-3fc3470d8581 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.741365] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-d0a4977e-c014-4f9c-803e-3fc3470d8581" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.741482] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-d0a4977e-c014-4f9c-803e-3fc3470d8581" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.741770] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-d0a4977e-c014-4f9c-803e-3fc3470d8581" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.741916] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0a4977e-c014-4f9c-803e-3fc3470d8581',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.753026] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.223566] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d in Status: SUCCESS [ 1050.223566] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.244828] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.245196] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.245412] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.245874] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.246187] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.246461] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port d0a4977e-c014-4f9c-803e-3fc3470d8581 not found, creating... [ 1050.246686] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.246913] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.246999] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.247347] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.247514] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.247876] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.248244] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.248468] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.248746] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.248901] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.249095] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: d0a4977e-c014-4f9c-803e-3fc3470d8581 is going to be created. [ 1050.253994] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.267858] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.268156] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.268307] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.268580] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.268878] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.269200] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-d0a4977e-c014-4f9c-803e-3fc3470d8581" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.508775] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: SUCCESS [ 1050.508966] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d deletion is rescheduled due to dependency. [ 1050.509103] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.760953] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.760953] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.760953] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.760953] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.760953] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.760953] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a is going to be updated. [ 1050.787566] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.787743] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.787802] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.788052] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.788177] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.796097] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a in Status: IN_PROGRESS for 2s [ 1050.944099] env[69506]: INFO networking_nsxv3.common.synchronization [req-8f731cae-9391-4de8-b840-cc739f04693d req-1f405a15-5391-4172-a0f5-94e8242d4bb7 service nova] Enqueued Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_rules [ 1050.944340] env[69506]: INFO networking_nsxv3.common.synchronization [req-8f731cae-9391-4de8-b840-cc739f04693d req-1f405a15-5391-4172-a0f5-94e8242d4bb7 service nova] Enqueued Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_members [ 1050.944440] env[69506]: INFO networking_nsxv3.common.synchronization [req-8f731cae-9391-4de8-b840-cc739f04693d req-1f405a15-5391-4172-a0f5-94e8242d4bb7 service nova] Enqueued Resource ID: d0a4977e-c014-4f9c-803e-3fc3470d8581 with Priority: HIGHEST for action port [ 1050.944933] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_rules [ 1050.945154] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_members [ 1050.945292] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0a4977e-c014-4f9c-803e-3fc3470d8581 with Priority: HIGHEST for action port [ 1050.945597] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2dbe38da-467a-45a1-9704-6b9d3f78430a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.947415] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.947415] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbe38da-467a-45a1-9704-6b9d3f78430a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.947415] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.947415] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0a4977e-c014-4f9c-803e-3fc3470d8581 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.947415] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0a4977e-c014-4f9c-803e-3fc3470d8581" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.947415] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0a4977e-c014-4f9c-803e-3fc3470d8581" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.947415] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0a4977e-c014-4f9c-803e-3fc3470d8581" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.947415] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0a4977e-c014-4f9c-803e-3fc3470d8581',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.448437] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d0a4977e-c014-4f9c-803e-3fc3470d8581 with status ACTIVE [ 1051.448962] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.449199] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.449289] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.449540] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.449762] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.449822] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.449893] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.449956] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.450177] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.450314] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.450420] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.450537] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.450575] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.450717] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.450777] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.450845] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d0a4977e-c014-4f9c-803e-3fc3470d8581 is going to be updated. [ 1051.470992] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.471143] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.471211] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.471410] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.471542] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.471708] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0a4977e-c014-4f9c-803e-3fc3470d8581" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.807131] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a in Status: SUCCESS [ 1052.807438] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.807684] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.807985] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.808228] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.808450] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.808519] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.808677] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.808767] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.808914] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.313972] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.609232] env[69506]: INFO networking_nsxv3.common.synchronization [req-dd0c7b9c-f544-4ee8-b49f-6696a772ecb2 req-350c9b1b-13da-44c5-ba95-73379ee9d1a8 tempest-ServerPasswordTestJSON-1959743883 tempest-ServerPasswordTestJSON-1959743883-project-member] Enqueued Resource ID: 38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d with Priority: HIGHEST for action security_group_members [ 1053.609232] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d with Priority: HIGHEST for action security_group_members [ 1053.609232] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.609232] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.609232] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.609232] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.609541] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.609541] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.609541] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.609651] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.609651] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.609835] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.817034] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.111605] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.111785] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.111959] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.112257] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.112382] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.112662] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.112797] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.112867] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.113042] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.113118] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.113208] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d is going to be updated. [ 1054.140655] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.140655] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.140655] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.140655] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.140655] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.148338] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d in Status: IN_PROGRESS for 2s [ 1054.321095] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.321095] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.321095] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.321095] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.321095] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.321095] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a is going to be updated. [ 1054.351568] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.351761] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.351761] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.351951] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.352180] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.360884] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a in Status: IN_PROGRESS for 2s [ 1055.581228] env[69506]: INFO networking_nsxv3.common.synchronization [req-5b63aa2c-d2e9-40f0-a128-5a9f92122601 req-ea352ee8-c4cf-4dd3-9780-6c35708dd670 tempest-AttachInterfacesTestJSON-2055467997 tempest-AttachInterfacesTestJSON-2055467997-project-member] Enqueued Resource ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 with Priority: HIGHEST for action security_group_members [ 1055.581796] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 with Priority: HIGHEST for action security_group_members [ 1055.582114] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.582235] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.582295] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.582632] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.582865] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.583207] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.583343] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.583546] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.583661] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.583779] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d9ed455-9c3f-46b7-9453-8a5f9cfb0580',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.958884] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-868 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.959156] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-868" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.959334] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-868" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.959658] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-868" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.959983] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.960409] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.960568] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.960889] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.961057] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.961348] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1055.961494] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1055.961662] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1055.961803] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1055.961950] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1055.962114] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1055.962295] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1055.980532] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1055.980736] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1055.980886] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1055.981125] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-868" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.981525] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-9216b047-1d7c-42c5-89e0-12ee29cceba1 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.981741] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-9216b047-1d7c-42c5-89e0-12ee29cceba1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.981898] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-9216b047-1d7c-42c5-89e0-12ee29cceba1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.982353] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-9216b047-1d7c-42c5-89e0-12ee29cceba1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.982605] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9216b047-1d7c-42c5-89e0-12ee29cceba1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.086209] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.086508] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.086508] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.086741] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.086836] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.087052] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.087160] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.087220] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.087375] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.087454] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.087542] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 already deleted. [ 1056.087624] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.159994] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d in Status: SUCCESS [ 1056.159994] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d deletion is rescheduled due to dependency. [ 1056.159994] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.371144] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a in Status: SUCCESS [ 1056.371440] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.371542] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.371751] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.371936] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.372057] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.372117] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.372278] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.372358] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.372442] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.372573] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.373734] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.373734] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.373734] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.373993] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.373993] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.374129] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.374129] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.374400] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.485400] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.485782] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.485974] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.486818] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.487076] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.487322] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 9216b047-1d7c-42c5-89e0-12ee29cceba1 not found, creating... [ 1056.487728] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.487992] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.488210] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.488509] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.488796] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.489223] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.489469] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.489606] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.489829] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.489972] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.490151] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 9216b047-1d7c-42c5-89e0-12ee29cceba1 is going to be created. [ 1056.509789] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.509993] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.510235] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.510512] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.510782] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.510995] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-9216b047-1d7c-42c5-89e0-12ee29cceba1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.877603] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbe38da-467a-45a1-9704-6b9d3f78430a taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.877603] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.877603] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.286977] env[69506]: INFO networking_nsxv3.common.synchronization [req-5b63aa2c-d2e9-40f0-a128-5a9f92122601 req-6ea3a03c-f7df-48bb-9033-0650c28946ee service nova] Enqueued Resource ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 with Priority: HIGHEST for action security_group_rules [ 1057.287188] env[69506]: INFO networking_nsxv3.common.synchronization [req-5b63aa2c-d2e9-40f0-a128-5a9f92122601 req-6ea3a03c-f7df-48bb-9033-0650c28946ee service nova] Enqueued Resource ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 with Priority: HIGHEST for action security_group_members [ 1057.287336] env[69506]: INFO networking_nsxv3.common.synchronization [req-5b63aa2c-d2e9-40f0-a128-5a9f92122601 req-6ea3a03c-f7df-48bb-9033-0650c28946ee service nova] Enqueued Resource ID: 9216b047-1d7c-42c5-89e0-12ee29cceba1 with Priority: HIGHEST for action port [ 1057.287564] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 with Priority: HIGHEST for action security_group_rules [ 1057.287691] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 with Priority: HIGHEST for action security_group_members [ 1057.287791] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9216b047-1d7c-42c5-89e0-12ee29cceba1 with Priority: HIGHEST for action port [ 1057.288358] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.288488] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.288641] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.288751] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.288827] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d9ed455-9c3f-46b7-9453-8a5f9cfb0580',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.289663] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.289785] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.290079] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.290079] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.290230] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.290284] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.290339] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.290477] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.290561] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.290649] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d9ed455-9c3f-46b7-9453-8a5f9cfb0580',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.291340] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-9216b047-1d7c-42c5-89e0-12ee29cceba1 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.291444] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9216b047-1d7c-42c5-89e0-12ee29cceba1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.291671] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9216b047-1d7c-42c5-89e0-12ee29cceba1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.291671] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9216b047-1d7c-42c5-89e0-12ee29cceba1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.291749] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9216b047-1d7c-42c5-89e0-12ee29cceba1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.379460] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.793394] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.793549] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.793849] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d9ed455-9c3f-46b7-9453-8a5f9cfb0580',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.794909] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9216b047-1d7c-42c5-89e0-12ee29cceba1 with status ACTIVE [ 1057.795022] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.795155] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.795193] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.795441] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.795512] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.795715] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.795913] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.795913] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.796138] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.796237] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.796523] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.796647] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.796754] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.796850] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.796983] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.796983] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9216b047-1d7c-42c5-89e0-12ee29cceba1 is going to be updated. [ 1057.816941] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.817137] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.817209] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.817411] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.817540] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.817700] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9216b047-1d7c-42c5-89e0-12ee29cceba1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.882527] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.882527] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.882527] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.882925] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.882925] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.882925] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a is going to be updated. [ 1057.910526] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.910689] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.910736] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.910948] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.911164] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.920779] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a in Status: IN_PROGRESS for 2s [ 1058.299092] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d9ed455-9c3f-46b7-9453-8a5f9cfb0580',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.801556] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.801797] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.801844] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.802122] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.802276] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.802357] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 is going to be created. [ 1058.824195] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.824374] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.824421] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.824652] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.824808] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.833438] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 in Status: UNINITIALIZED for 2s [ 1059.932047] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a in Status: SUCCESS [ 1059.932481] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.932481] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.932707] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.932895] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.933015] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.933083] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.933302] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.933377] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.933475] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.933658] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbe38da-467a-45a1-9704-6b9d3f78430a taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.933755] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.933804] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.933947] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.934120] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.934464] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.934464] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.934594] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.934746] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.934746] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.934857] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.436816] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2dbe38da-467a-45a1-9704-6b9d3f78430a: rpc.has_security_group_logging(os_id): False [ 1060.458243] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.458431] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.458506] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.458722] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.458812] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.459051] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.459154] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.459219] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.459377] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.459456] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.459636] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.459728] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.459788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.459930] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.460013] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.460301] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.460474] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.460606] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.460713] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.460799] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.460895] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a is going to be updated. [ 1060.518306] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.518464] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.518514] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.518703] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.518838] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.532620] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a in Status: IN_PROGRESS for 2s [ 1060.854819] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 in Status: SUCCESS [ 1060.855194] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.855194] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.855375] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.855564] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.855679] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.855743] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.855933] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.856032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.856129] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.856223] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d9ed455-9c3f-46b7-9453-8a5f9cfb0580',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.358113] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d9ed455-9c3f-46b7-9453-8a5f9cfb0580',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.861661] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580: rpc.has_security_group_logging(os_id): False [ 1061.881563] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.881771] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.881958] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.882289] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.882740] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.883413] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.886186] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.886261] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.886437] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.886523] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.886617] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 is going to be created. [ 1061.960937] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.961466] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.961591] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.961875] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.962149] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.981347] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 in Status: IN_PROGRESS for 2s [ 1062.098509] env[69506]: INFO networking_nsxv3.common.synchronization [req-07d8e47c-7693-4c58-8332-c919c3d1d683 req-c3973676-cdf6-467a-bde0-ba91eca45e83 tempest-ServersTestMultiNic-1599747181 tempest-ServersTestMultiNic-1599747181-project-member] Enqueued Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_members [ 1062.099038] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_members [ 1062.099437] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbe38da-467a-45a1-9704-6b9d3f78430a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.099537] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.099537] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.099716] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.099866] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.099963] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.100492] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.100994] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.101315] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.101465] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.158838] env[69506]: INFO networking_nsxv3.common.synchronization [req-0cc46490-ef02-4b00-af40-3995c6aaddbd req-08bffa32-04e6-46bb-a26f-23c5b53bfac9 tempest-ServersTestJSON-1801092994 tempest-ServersTestJSON-1801092994-project-member] Enqueued Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 1062.159090] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 1062.159398] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.159519] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.159588] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.159785] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.159930] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.160135] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.160258] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.160444] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.160562] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.160681] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.299806] env[69506]: INFO networking_nsxv3.common.synchronization [req-a5dff496-c88c-46fe-bef3-add983b19679 req-f0d20238-94c1-4870-ad4d-1532543518d3 tempest-ServerRescueNegativeTestJSON-1844285858 tempest-ServerRescueNegativeTestJSON-1844285858-project-member] Enqueued Resource ID: 20940711-36df-48c2-b8ae-df2cfecaebc8 with Priority: HIGHEST for action security_group_members [ 1062.300739] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20940711-36df-48c2-b8ae-df2cfecaebc8 with Priority: HIGHEST for action security_group_members [ 1062.301081] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-20940711-36df-48c2-b8ae-df2cfecaebc8 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.301211] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20940711-36df-48c2-b8ae-df2cfecaebc8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.301310] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20940711-36df-48c2-b8ae-df2cfecaebc8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.301560] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20940711-36df-48c2-b8ae-df2cfecaebc8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.301776] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.301918] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.301984] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.302154] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.302243] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.302374] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20940711-36df-48c2-b8ae-df2cfecaebc8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.456936] env[69506]: INFO networking_nsxv3.common.synchronization [req-07d8e47c-7693-4c58-8332-c919c3d1d683 req-11d17252-6365-4e9c-9fd8-97a7398a65c5 tempest-ServersTestMultiNic-1599747181 tempest-ServersTestMultiNic-1599747181-project-member] Enqueued Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_members [ 1062.457522] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a with Priority: HIGHEST for action security_group_members [ 1062.457880] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbe38da-467a-45a1-9704-6b9d3f78430a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.458033] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.473079] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-54 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.474443] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-54" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.474691] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-54" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.475029] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-54" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.475361] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.477247] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.477390] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.477684] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.477876] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.478179] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1062.478343] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1062.478522] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1062.478678] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1062.478841] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1062.479062] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1062.483019] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1062.504077] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1062.504392] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1062.504515] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1062.504785] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-54" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.505041] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-b671ad9d-9277-4108-a8ec-8a094405058c taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.505230] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-b671ad9d-9277-4108-a8ec-8a094405058c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.505356] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-b671ad9d-9277-4108-a8ec-8a094405058c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.505683] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-b671ad9d-9277-4108-a8ec-8a094405058c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.505826] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b671ad9d-9277-4108-a8ec-8a094405058c',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.548536] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a in Status: SUCCESS [ 1062.548821] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.549138] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.549200] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.549287] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.605262] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.664267] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.805102] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.805262] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.805354] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.805603] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.827853] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.828122] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.828242] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.828312] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.828508] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.828589] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.828679] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20940711-36df-48c2-b8ae-df2cfecaebc8 is going to be updated. [ 1062.866809] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.867012] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.867065] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.867287] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.867419] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.877189] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20940711-36df-48c2-b8ae-df2cfecaebc8 in Status: IN_PROGRESS for 2s [ 1063.009613] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.009878] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.010017] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.010366] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.010495] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.010698] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port b671ad9d-9277-4108-a8ec-8a094405058c not found, creating... [ 1063.010912] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.011087] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.011231] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.011469] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.011613] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.011925] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.012099] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.012222] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.012435] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.012582] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.012743] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: b671ad9d-9277-4108-a8ec-8a094405058c is going to be created. [ 1063.057711] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.057906] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.058056] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.058326] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.058614] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.058860] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-b671ad9d-9277-4108-a8ec-8a094405058c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.071599] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.071782] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.071828] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.072102] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.072205] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.072313] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a is going to be deleted. [ 1063.106914] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.164731] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.222948] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.223756] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.223756] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.223756] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.223756] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.223756] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.609804] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.610288] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.610288] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.610455] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.610581] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.610720] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a is going to be updated. [ 1063.639865] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.640046] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.640146] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.640448] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.640612] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.649119] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a in Status: IN_PROGRESS for 2s [ 1063.668409] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.668603] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.668705] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.668891] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.668994] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.669161] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc is going to be updated. [ 1063.711767] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.712045] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.712045] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.712283] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.712434] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.723835] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: IN_PROGRESS for 2s [ 1063.775026] env[69506]: INFO networking_nsxv3.common.synchronization [req-0cc46490-ef02-4b00-af40-3995c6aaddbd req-e332400f-9e3d-40f2-b511-97e1111fd876 service nova] Enqueued Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_rules [ 1063.775242] env[69506]: INFO networking_nsxv3.common.synchronization [req-0cc46490-ef02-4b00-af40-3995c6aaddbd req-e332400f-9e3d-40f2-b511-97e1111fd876 service nova] Enqueued Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 1063.775496] env[69506]: INFO networking_nsxv3.common.synchronization [req-0cc46490-ef02-4b00-af40-3995c6aaddbd req-e332400f-9e3d-40f2-b511-97e1111fd876 service nova] Enqueued Resource ID: b671ad9d-9277-4108-a8ec-8a094405058c with Priority: HIGHEST for action port [ 1063.776020] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_rules [ 1063.778116] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 1063.778277] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b671ad9d-9277-4108-a8ec-8a094405058c with Priority: HIGHEST for action port [ 1063.778710] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.778856] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.778926] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.779253] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.779343] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.781223] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.781881] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.782189] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-b671ad9d-9277-4108-a8ec-8a094405058c taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.782314] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b671ad9d-9277-4108-a8ec-8a094405058c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.782425] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b671ad9d-9277-4108-a8ec-8a094405058c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.782579] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b671ad9d-9277-4108-a8ec-8a094405058c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.782781] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b671ad9d-9277-4108-a8ec-8a094405058c',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.996769] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 in Status: SUCCESS [ 1063.998093] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.106948] env[69506]: INFO networking_nsxv3.common.synchronization [req-1c246021-5fef-4c74-98a2-a0c2e15ec5e1 req-03c5e906-e544-4175-9825-97d8cc96be0d tempest-ImagesOneServerNegativeTestJSON-1660335094 tempest-ImagesOneServerNegativeTestJSON-1660335094-project-member] Enqueued Resource ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 with Priority: HIGHEST for action security_group_members [ 1064.106948] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 with Priority: HIGHEST for action security_group_members [ 1064.106948] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bc29505-f5b4-4554-85b9-541273bd8da3 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.107158] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.107158] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.107323] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.107473] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.108433] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.108433] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.108433] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.108433] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.108433] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bc29505-f5b4-4554-85b9-541273bd8da3',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.287973] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b671ad9d-9277-4108-a8ec-8a094405058c with status ACTIVE [ 1064.289505] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.289505] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.289669] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.290066] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.290066] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.290066] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.290292] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.290292] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.290415] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.290497] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.290685] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.290776] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.290836] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.291233] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.291233] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.291233] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b671ad9d-9277-4108-a8ec-8a094405058c is going to be updated. [ 1064.293999] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.294123] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.313369] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.313543] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.313587] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.313768] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.313891] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.314063] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b671ad9d-9277-4108-a8ec-8a094405058c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.472549] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-370 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.472755] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-370" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.472902] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-370" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.473177] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-370" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.473446] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.473613] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.473739] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.473964] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.474129] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.474346] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1064.474462] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1064.474576] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1064.474689] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1064.474801] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1064.474909] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1064.475054] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1064.495091] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1064.495279] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1064.495420] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1064.495593] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-370" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.495886] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-88566e7d-c7c7-4c06-bf8b-92fc7b5796cf taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.496081] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-88566e7d-c7c7-4c06-bf8b-92fc7b5796cf" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.496190] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-88566e7d-c7c7-4c06-bf8b-92fc7b5796cf" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.496487] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-88566e7d-c7c7-4c06-bf8b-92fc7b5796cf" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.496624] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88566e7d-c7c7-4c06-bf8b-92fc7b5796cf',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.610340] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.610657] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.610657] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.610871] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.610985] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.611265] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.611397] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.611467] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.611648] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.611741] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.611850] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 is going to be updated. [ 1064.635858] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.635996] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.636094] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.636301] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.636429] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.645423] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 in Status: IN_PROGRESS for 2s [ 1064.887677] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20940711-36df-48c2-b8ae-df2cfecaebc8 in Status: SUCCESS [ 1064.887937] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20940711-36df-48c2-b8ae-df2cfecaebc8 deletion is rescheduled due to dependency. [ 1064.888053] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20940711-36df-48c2-b8ae-df2cfecaebc8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.998678] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.999861] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.999861] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.999861] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.999861] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.999861] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 88566e7d-c7c7-4c06-bf8b-92fc7b5796cf not found, creating... [ 1065.000499] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.000499] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.000499] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.000499] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.000679] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.000884] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.001451] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.001628] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.001851] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.001990] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.002150] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 88566e7d-c7c7-4c06-bf8b-92fc7b5796cf is going to be created. [ 1065.023584] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.023843] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.024022] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.024313] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.024584] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.024853] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-88566e7d-c7c7-4c06-bf8b-92fc7b5796cf" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.126239] env[69506]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1065.126382] env[69506]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] NSXv3 Agent Agent loop - iteration:2 started [ 1065.659014] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a in Status: SUCCESS [ 1065.659332] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.659447] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.659679] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.659891] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.663798] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.663944] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.664234] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.664332] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.664441] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2dbe38da-467a-45a1-9704-6b9d3f78430a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.732978] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: SUCCESS [ 1065.733297] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.733539] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.733757] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.733964] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.734095] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.734153] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.734319] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.734416] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.734518] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.099791] env[69506]: INFO networking_nsxv3.common.synchronization [req-1c246021-5fef-4c74-98a2-a0c2e15ec5e1 req-7d49d4eb-6c1d-4055-8806-c1be698b22a5 service nova] Enqueued Resource ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 with Priority: HIGHEST for action security_group_rules [ 1066.099791] env[69506]: INFO networking_nsxv3.common.synchronization [req-1c246021-5fef-4c74-98a2-a0c2e15ec5e1 req-7d49d4eb-6c1d-4055-8806-c1be698b22a5 service nova] Enqueued Resource ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 with Priority: HIGHEST for action security_group_members [ 1066.099791] env[69506]: INFO networking_nsxv3.common.synchronization [req-1c246021-5fef-4c74-98a2-a0c2e15ec5e1 req-7d49d4eb-6c1d-4055-8806-c1be698b22a5 service nova] Enqueued Resource ID: 88566e7d-c7c7-4c06-bf8b-92fc7b5796cf with Priority: HIGHEST for action port [ 1066.099791] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 with Priority: HIGHEST for action security_group_rules [ 1066.099791] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 with Priority: HIGHEST for action security_group_members [ 1066.099791] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88566e7d-c7c7-4c06-bf8b-92fc7b5796cf with Priority: HIGHEST for action port [ 1066.099791] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0bc29505-f5b4-4554-85b9-541273bd8da3 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.099791] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.099791] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.099791] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.099791] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0bc29505-f5b4-4554-85b9-541273bd8da3',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.099791] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bc29505-f5b4-4554-85b9-541273bd8da3 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.103998] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.103998] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-88566e7d-c7c7-4c06-bf8b-92fc7b5796cf taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.103998] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88566e7d-c7c7-4c06-bf8b-92fc7b5796cf" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.103998] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88566e7d-c7c7-4c06-bf8b-92fc7b5796cf" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.103998] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88566e7d-c7c7-4c06-bf8b-92fc7b5796cf" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.103998] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88566e7d-c7c7-4c06-bf8b-92fc7b5796cf',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.169633] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.169633] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.169633] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.169633] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.169633] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.169633] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.169633] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.169633] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.169633] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.169633] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.169633] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dbe38da-467a-45a1-9704-6b9d3f78430a is going to be deleted. [ 1066.237264] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.239531] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.239984] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.240313] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.241017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.241017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.241017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbe38da-467a-45a1-9704-6b9d3f78430a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.605578] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bc29505-f5b4-4554-85b9-541273bd8da3 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.605701] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.605877] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 88566e7d-c7c7-4c06-bf8b-92fc7b5796cf with status ACTIVE [ 1066.606059] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.606169] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.606237] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.606455] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.606546] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.606721] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.606817] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.606880] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.607048] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.607129] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.607445] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.607511] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.607561] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.607672] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.607752] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.607837] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 88566e7d-c7c7-4c06-bf8b-92fc7b5796cf is going to be updated. [ 1066.738750] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 in Status: SUCCESS [ 1066.739160] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 deletion is rescheduled due to dependency. [ 1066.739160] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.739257] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.740015] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.740015] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.740015] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.740015] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.740015] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.740381] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.740381] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bc29505-f5b4-4554-85b9-541273bd8da3',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.741801] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.752957] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.753159] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.753255] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.753901] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.753901] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.753901] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88566e7d-c7c7-4c06-bf8b-92fc7b5796cf" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.867313] env[69506]: INFO networking_nsxv3.common.synchronization [req-59422a99-3f16-4589-b3d3-906247830101 req-9b4c834f-c452-4bbf-9720-33c579a8bb96 tempest-AttachVolumeNegativeTest-402732870 tempest-AttachVolumeNegativeTest-402732870-project-member] Enqueued Resource ID: 23c9b5f8-1cff-4d68-a385-35487b841eb9 with Priority: HIGHEST for action security_group_members [ 1066.867856] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23c9b5f8-1cff-4d68-a385-35487b841eb9 with Priority: HIGHEST for action security_group_members [ 1066.868187] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-23c9b5f8-1cff-4d68-a385-35487b841eb9 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.868337] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23c9b5f8-1cff-4d68-a385-35487b841eb9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.868408] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23c9b5f8-1cff-4d68-a385-35487b841eb9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.868644] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23c9b5f8-1cff-4d68-a385-35487b841eb9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.868771] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.868956] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.868956] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.869455] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.869558] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.869657] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23c9b5f8-1cff-4d68-a385-35487b841eb9',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.242765] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0bc29505-f5b4-4554-85b9-541273bd8da3',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.247506] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.247648] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.247719] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.247927] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.248031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.248161] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc is going to be updated. [ 1067.305623] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.305796] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.305870] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.306109] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.306315] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.322893] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: IN_PROGRESS for 2s [ 1067.374093] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.374269] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.374314] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.376434] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.376434] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.376434] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.376434] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.376434] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.376434] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.376434] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.376434] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23c9b5f8-1cff-4d68-a385-35487b841eb9 is going to be updated. [ 1067.403140] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.403283] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.403355] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.403562] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.403699] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.411601] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23c9b5f8-1cff-4d68-a385-35487b841eb9 in Status: IN_PROGRESS for 2s [ 1067.745974] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0bc29505-f5b4-4554-85b9-541273bd8da3',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.247715] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.247794] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.247837] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.248802] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.248802] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.248802] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 is going to be updated. [ 1068.280562] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.280708] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.280779] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.281009] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.281159] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.292317] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 in Status: IN_PROGRESS for 2s [ 1069.333853] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: SUCCESS [ 1069.334224] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.334266] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.334457] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.334641] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.334757] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.334820] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.334975] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.335072] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.335160] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.335253] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.419932] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23c9b5f8-1cff-4d68-a385-35487b841eb9 in Status: SUCCESS [ 1069.420169] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23c9b5f8-1cff-4d68-a385-35487b841eb9 deletion is rescheduled due to dependency. [ 1069.420246] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23c9b5f8-1cff-4d68-a385-35487b841eb9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.837345] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.837541] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.837659] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.837843] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.838033] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.838186] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.838305] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.838535] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.838633] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.838756] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.839074] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.839185] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.839267] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.839493] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.839770] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.839840] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.839881] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.840107] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.840249] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.840377] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.840477] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.302258] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 in Status: SUCCESS [ 1070.302572] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.302912] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.303131] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.303442] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.303594] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.303690] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.303938] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.304028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.304166] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.304301] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0bc29505-f5b4-4554-85b9-541273bd8da3',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.343322] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc: rpc.has_security_group_logging(os_id): False [ 1070.360616] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.360832] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.360890] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.361195] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.361305] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.361602] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.361602] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.361746] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.361844] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.361962] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.362163] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.362457] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.362457] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.362457] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.362589] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.362735] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.363144] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.363144] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.369091] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.369322] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.369453] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc is going to be updated. [ 1070.438358] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.438700] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.438700] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.438871] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.439040] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.454061] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: IN_PROGRESS for 2s [ 1070.528419] env[69506]: INFO networking_nsxv3.common.synchronization [None req-bc683367-a858-4e65-b7a5-cac468c52c90 None None] Enqueued Resource ID: 20347a4c-6af0-4125-b55b-c0bd64486c05 with Priority: HIGHEST for action port [ 1070.528856] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20347a4c-6af0-4125-b55b-c0bd64486c05 with Priority: HIGHEST for action port [ 1070.529291] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-20347a4c-6af0-4125-b55b-c0bd64486c05 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.529411] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20347a4c-6af0-4125-b55b-c0bd64486c05" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.529411] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20347a4c-6af0-4125-b55b-c0bd64486c05" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.529643] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20347a4c-6af0-4125-b55b-c0bd64486c05" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.529728] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20347a4c-6af0-4125-b55b-c0bd64486c05',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.608065] env[69506]: INFO networking_nsxv3.common.synchronization [req-5d9e27c5-72cf-4b5b-a053-34fcd8c75f93 req-26df3aef-8fba-437d-a9e8-867bbc322580 tempest-DeleteServersTestJSON-1880805458 tempest-DeleteServersTestJSON-1880805458-project-member] Enqueued Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_members [ 1070.608065] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_members [ 1070.608065] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.609085] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.609219] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.609465] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.609642] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.609749] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.609813] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.610010] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.610073] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.610166] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.807196] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bc29505-f5b4-4554-85b9-541273bd8da3 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.807428] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.807537] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.807782] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.807999] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.808429] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.809053] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.809596] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.809596] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.809596] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.809596] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bc29505-f5b4-4554-85b9-541273bd8da3 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.809969] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.809969] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.811693] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.812850] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.812850] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.813405] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.813616] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.813886] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.814013] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.814169] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0bc29505-f5b4-4554-85b9-541273bd8da3',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.031398] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 20347a4c-6af0-4125-b55b-c0bd64486c05 [ 1071.032247] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.032247] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.032247] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.032247] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.032247] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.032247] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:20347a4c-6af0-4125-b55b-c0bd64486c05 already deleted. [ 1071.032599] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20347a4c-6af0-4125-b55b-c0bd64486c05" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.076018] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-628 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.076018] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-628" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.076018] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-628" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.076018] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-628" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.076018] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.076018] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.076018] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.076444] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.076444] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.076444] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1071.076564] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1071.076647] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1071.076751] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1071.076859] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1071.076961] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1071.077200] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1071.095472] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1071.095472] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1071.095472] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1071.095764] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-628" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.095875] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-7a58b20a-c47a-457a-bc15-e97913c4f912 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.096409] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-7a58b20a-c47a-457a-bc15-e97913c4f912" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.096409] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-7a58b20a-c47a-457a-bc15-e97913c4f912" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.096606] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-7a58b20a-c47a-457a-bc15-e97913c4f912" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.096745] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a58b20a-c47a-457a-bc15-e97913c4f912',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.112332] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.112486] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.112549] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.112757] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.112848] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.113053] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.113155] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.113380] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.113446] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.113574] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.113636] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d is going to be updated. [ 1071.141659] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.141659] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.141659] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.141659] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.141659] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.148393] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: IN_PROGRESS for 2s [ 1071.320409] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0bc29505-f5b4-4554-85b9-541273bd8da3: rpc.has_security_group_logging(os_id): False [ 1071.337043] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.337043] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.337043] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.337043] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.337358] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.337618] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.337795] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.337960] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.338313] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.338457] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.338732] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.338907] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.339034] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.339251] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.339421] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.339636] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.340659] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.340659] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.340659] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.340659] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.340659] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 is going to be updated. [ 1071.396402] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.396802] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.396802] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.396890] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.396964] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.407570] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 in Status: IN_PROGRESS for 2s [ 1071.601519] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.601519] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.601519] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.601519] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.601519] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.602821] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 7a58b20a-c47a-457a-bc15-e97913c4f912 not found, creating... [ 1071.603032] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.603283] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.603466] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.603862] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.604083] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.604510] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.604709] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.604833] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.605110] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.605655] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.605655] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 7a58b20a-c47a-457a-bc15-e97913c4f912 is going to be created. [ 1071.633827] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.633966] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.634110] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.634431] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.634671] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.634902] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-7a58b20a-c47a-457a-bc15-e97913c4f912" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.470047] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: SUCCESS [ 1072.470047] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.507219] env[69506]: INFO networking_nsxv3.common.synchronization [req-5d9e27c5-72cf-4b5b-a053-34fcd8c75f93 req-bfbd531f-1ee4-486f-871a-3ce3d63cb431 service nova] Enqueued Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_rules [ 1072.507219] env[69506]: INFO networking_nsxv3.common.synchronization [req-5d9e27c5-72cf-4b5b-a053-34fcd8c75f93 req-bfbd531f-1ee4-486f-871a-3ce3d63cb431 service nova] Enqueued Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_members [ 1072.507219] env[69506]: INFO networking_nsxv3.common.synchronization [req-5d9e27c5-72cf-4b5b-a053-34fcd8c75f93 req-bfbd531f-1ee4-486f-871a-3ce3d63cb431 service nova] Enqueued Resource ID: 7a58b20a-c47a-457a-bc15-e97913c4f912 with Priority: HIGHEST for action port [ 1072.507219] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_rules [ 1072.507219] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_members [ 1072.507219] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a58b20a-c47a-457a-bc15-e97913c4f912 with Priority: HIGHEST for action port [ 1072.507219] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.511029] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.511166] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.511483] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.511577] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.513187] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.513427] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.513741] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a58b20a-c47a-457a-bc15-e97913c4f912 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.514010] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a58b20a-c47a-457a-bc15-e97913c4f912" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.514173] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a58b20a-c47a-457a-bc15-e97913c4f912" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.514445] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a58b20a-c47a-457a-bc15-e97913c4f912" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.514638] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a58b20a-c47a-457a-bc15-e97913c4f912',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.689606] env[69506]: INFO networking_nsxv3.common.synchronization [None req-be12855f-25a3-4ef4-b31e-f0f33e440812 None None] Enqueued Resource ID: 53ddcffa-3409-4f13-a6fe-a31a82d4ef41 with Priority: HIGHEST for action port [ 1072.690159] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53ddcffa-3409-4f13-a6fe-a31a82d4ef41 with Priority: HIGHEST for action port [ 1072.690497] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-53ddcffa-3409-4f13-a6fe-a31a82d4ef41 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.690647] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53ddcffa-3409-4f13-a6fe-a31a82d4ef41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.690717] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53ddcffa-3409-4f13-a6fe-a31a82d4ef41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.690984] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53ddcffa-3409-4f13-a6fe-a31a82d4ef41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.691079] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53ddcffa-3409-4f13-a6fe-a31a82d4ef41',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.016483] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.016483] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.016729] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7a58b20a-c47a-457a-bc15-e97913c4f912 with status ACTIVE [ 1073.016729] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.016831] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.016831] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.020020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.020020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.020020] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.020020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.020020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.020020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.020020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.020020] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.020020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.020020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.020020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.020020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.020020] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7a58b20a-c47a-457a-bc15-e97913c4f912 is going to be updated. [ 1073.040368] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.040556] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.040623] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.040785] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.040915] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.041108] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a58b20a-c47a-457a-bc15-e97913c4f912" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.161163] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: SUCCESS [ 1073.161362] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d deletion is rescheduled due to dependency. [ 1073.161541] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.161641] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.161966] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.162055] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.162255] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.162255] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.162384] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.162462] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.162555] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.194051] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 53ddcffa-3409-4f13-a6fe-a31a82d4ef41 [ 1073.194051] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.194051] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.194265] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.194441] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.194543] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.194643] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:53ddcffa-3409-4f13-a6fe-a31a82d4ef41 already deleted. [ 1073.194730] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53ddcffa-3409-4f13-a6fe-a31a82d4ef41" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.419739] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 in Status: SUCCESS [ 1073.420017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.667338] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.169942] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.674368] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.674368] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.674368] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.674368] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.674368] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.674368] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d is going to be updated. [ 1074.701020] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.701020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.701020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.701020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.701020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.708186] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: IN_PROGRESS for 2s [ 1076.298570] env[69506]: INFO networking_nsxv3.common.synchronization [req-704f8e68-9603-4c39-bda0-0856dd12e11d req-5a7db0b4-77f3-459e-b283-f9cb31885e66 tempest-ImagesOneServerNegativeTestJSON-1660335094 tempest-ImagesOneServerNegativeTestJSON-1660335094-project-member] Enqueued Resource ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 with Priority: HIGHEST for action security_group_members [ 1076.299252] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 with Priority: HIGHEST for action security_group_members [ 1076.299600] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bc29505-f5b4-4554-85b9-541273bd8da3 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.299763] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.299861] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.300089] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.300251] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.300377] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.300449] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.300606] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.300690] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.300784] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bc29505-f5b4-4554-85b9-541273bd8da3',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.720572] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: SUCCESS [ 1076.720572] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.720572] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.720572] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.720572] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.720572] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.720572] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.720928] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.720928] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.720928] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.720928] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.805371] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.805371] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.805371] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.805371] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.805371] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.805371] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.805371] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.805371] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.805371] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.805371] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.805371] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 is going to be updated. [ 1076.829577] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.829577] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.829577] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.829796] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.829912] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.839150] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 in Status: IN_PROGRESS for 2s [ 1077.223205] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.223358] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.223436] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.223667] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.223932] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.223932] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.224032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.224877] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.224877] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.224877] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.224877] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.224877] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.224877] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.224877] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.225206] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.225206] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.225206] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.225206] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.225334] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.225368] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.225458] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.727855] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d: rpc.has_security_group_logging(os_id): False [ 1077.731324] env[69506]: INFO networking_nsxv3.common.synchronization [req-a2bd22f8-abf2-42bf-9c03-67d0bb0e7547 req-bbdde122-eec7-48ac-a551-c2e5bb1c5e5f tempest-AttachInterfacesTestJSON-2055467997 tempest-AttachInterfacesTestJSON-2055467997-project-member] Enqueued Resource ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 with Priority: HIGHEST for action security_group_members [ 1077.731833] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 with Priority: HIGHEST for action security_group_members [ 1077.732141] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.732262] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.732329] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.732666] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.732834] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.732937] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.733000] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.733170] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.733254] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.733344] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d9ed455-9c3f-46b7-9453-8a5f9cfb0580',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.748626] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.748626] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.748626] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.748626] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.748626] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.748626] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.748626] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.748626] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.748626] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.748626] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.748626] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.748626] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.748626] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.748626] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.748626] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.749173] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.749173] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.749173] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.749449] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.749612] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.749773] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d is going to be updated. [ 1077.828041] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.828041] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.828041] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.828041] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.828041] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.842250] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: IN_PROGRESS for 2s [ 1078.108332] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-868 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.108535] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-868" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.108667] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-868" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.108946] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-868" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.109224] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.109389] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.109512] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.109723] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.109870] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.110100] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1078.110218] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1078.110393] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1078.110467] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1078.110567] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1078.110678] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1078.110850] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1078.127358] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1078.127524] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1078.127660] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1078.127841] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-868" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.128511] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-8511a086-8550-433e-ac61-73d1154b8aba taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.128511] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-8511a086-8550-433e-ac61-73d1154b8aba" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.128511] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-8511a086-8550-433e-ac61-73d1154b8aba" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.128782] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-8511a086-8550-433e-ac61-73d1154b8aba" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.128896] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8511a086-8550-433e-ac61-73d1154b8aba',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.235569] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d9ed455-9c3f-46b7-9453-8a5f9cfb0580',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.631560] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.631831] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.631997] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.632330] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.632493] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.632662] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 8511a086-8550-433e-ac61-73d1154b8aba not found, creating... [ 1078.632961] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.633151] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.633277] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.633506] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.633652] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.633947] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.634166] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.634307] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.634569] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.634716] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.634923] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 8511a086-8550-433e-ac61-73d1154b8aba is going to be created. [ 1078.655454] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.655634] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.655762] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.656009] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.656242] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.656461] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-8511a086-8550-433e-ac61-73d1154b8aba" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.739048] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d9ed455-9c3f-46b7-9453-8a5f9cfb0580',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.849923] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 in Status: SUCCESS [ 1078.850126] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 deletion is rescheduled due to dependency. [ 1078.850239] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.009082] env[69506]: INFO networking_nsxv3.common.synchronization [req-d5c6ae30-ce14-46c4-8731-25ebab293135 req-db6cabfe-ef9d-4a1c-a2c1-6031201ed8da tempest-ServerRescueNegativeTestJSON-1844285858 tempest-ServerRescueNegativeTestJSON-1844285858-project-member] Enqueued Resource ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 with Priority: HIGHEST for action security_group_members [ 1079.010274] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 with Priority: HIGHEST for action security_group_members [ 1079.010635] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-76ac020a-e732-4afe-ace5-7bd4b6ea9072 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.010754] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.010820] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.011037] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.011191] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.011293] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.011354] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.011522] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.011606] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.011712] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76ac020a-e732-4afe-ace5-7bd4b6ea9072',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.241656] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.241809] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.241987] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.242115] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.242206] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.242307] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 is going to be updated. [ 1079.267375] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.267503] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.267686] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.267952] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.268110] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.276573] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 in Status: IN_PROGRESS for 2s [ 1079.397397] env[69506]: INFO networking_nsxv3.common.synchronization [req-a2bd22f8-abf2-42bf-9c03-67d0bb0e7547 req-38c0e26b-8e6e-499f-a3d8-53766da58e13 service nova] Enqueued Resource ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 with Priority: HIGHEST for action security_group_rules [ 1079.397579] env[69506]: INFO networking_nsxv3.common.synchronization [req-a2bd22f8-abf2-42bf-9c03-67d0bb0e7547 req-38c0e26b-8e6e-499f-a3d8-53766da58e13 service nova] Enqueued Resource ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 with Priority: HIGHEST for action security_group_members [ 1079.397725] env[69506]: INFO networking_nsxv3.common.synchronization [req-a2bd22f8-abf2-42bf-9c03-67d0bb0e7547 req-38c0e26b-8e6e-499f-a3d8-53766da58e13 service nova] Enqueued Resource ID: 8511a086-8550-433e-ac61-73d1154b8aba with Priority: HIGHEST for action port [ 1079.398245] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 with Priority: HIGHEST for action security_group_rules [ 1079.398370] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 with Priority: HIGHEST for action security_group_members [ 1079.398469] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8511a086-8550-433e-ac61-73d1154b8aba with Priority: HIGHEST for action port [ 1079.398737] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.398886] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.398917] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.399238] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.399322] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d9ed455-9c3f-46b7-9453-8a5f9cfb0580',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.400604] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.400724] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.400965] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-8511a086-8550-433e-ac61-73d1154b8aba taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.401086] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8511a086-8550-433e-ac61-73d1154b8aba" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.401169] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8511a086-8550-433e-ac61-73d1154b8aba" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.401317] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8511a086-8550-433e-ac61-73d1154b8aba" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.401431] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8511a086-8550-433e-ac61-73d1154b8aba',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.513991] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76ac020a-e732-4afe-ace5-7bd4b6ea9072',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.856029] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: SUCCESS [ 1079.856029] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.905146] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.905319] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.905540] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8511a086-8550-433e-ac61-73d1154b8aba with status ACTIVE [ 1079.905709] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.906061] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.906287] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.906605] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.906759] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.907261] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.907636] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.907774] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.908039] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.908175] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.908700] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.908824] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.908891] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.909303] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.909435] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.909558] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8511a086-8550-433e-ac61-73d1154b8aba is going to be updated. [ 1079.930985] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.931146] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.931221] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.931459] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.931650] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.931816] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8511a086-8550-433e-ac61-73d1154b8aba" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.016418] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76ac020a-e732-4afe-ace5-7bd4b6ea9072',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.519089] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.519320] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.519428] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.519670] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.519788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.519911] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 is going to be updated. [ 1080.544760] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.544901] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.544980] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.545192] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.545368] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.553352] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 in Status: IN_PROGRESS for 2s [ 1081.289113] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 in Status: SUCCESS [ 1081.289113] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.289113] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.289113] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.289113] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.289113] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.289113] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.289113] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.289113] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.289113] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d9ed455-9c3f-46b7-9453-8a5f9cfb0580',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.793163] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d9ed455-9c3f-46b7-9453-8a5f9cfb0580',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.852215] env[69506]: INFO networking_nsxv3.common.synchronization [req-14c68d81-c121-4e77-bb51-7bd363a0152a req-a9bd4e6a-5755-45ba-8793-c06b552c702e tempest-ServersNegativeTestJSON-1250642852 tempest-ServersNegativeTestJSON-1250642852-project-member] Enqueued Resource ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca with Priority: HIGHEST for action security_group_members [ 1081.852844] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca with Priority: HIGHEST for action security_group_members [ 1081.853071] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.853273] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.853355] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.853558] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.854064] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.854064] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.854064] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.854064] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.854196] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.854239] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0461c6a-1d2b-401e-b59f-af6eda84b6ca',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.166538] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-324 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.166747] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-324" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.166877] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-324" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.167236] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-324" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.167502] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.167664] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.167787] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.168010] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.168166] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.168388] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1082.168515] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1082.168629] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1082.168741] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1082.168853] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1082.168962] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1082.169113] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1082.192933] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1082.193064] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1082.193207] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1082.193378] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-324" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.193666] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-bf5a8cb7-b206-46b1-8d38-092266d7ca57 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.193844] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-bf5a8cb7-b206-46b1-8d38-092266d7ca57" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.193973] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-bf5a8cb7-b206-46b1-8d38-092266d7ca57" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.194286] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-bf5a8cb7-b206-46b1-8d38-092266d7ca57" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.194426] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf5a8cb7-b206-46b1-8d38-092266d7ca57',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.295302] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d9ed455-9c3f-46b7-9453-8a5f9cfb0580',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.356713] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.356880] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.356971] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.357229] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.357299] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.357520] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.357661] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.357661] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.357810] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.357886] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.357973] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca already deleted. [ 1082.358075] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.562383] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 in Status: SUCCESS [ 1082.562632] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.697080] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.697299] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.697459] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.697756] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.697944] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.698129] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port bf5a8cb7-b206-46b1-8d38-092266d7ca57 not found, creating... [ 1082.698432] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.698638] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.698761] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.699020] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.699259] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.699635] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.699740] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.699773] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.700027] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.700180] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.700335] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: bf5a8cb7-b206-46b1-8d38-092266d7ca57 is going to be created. [ 1082.720019] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.720019] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.720019] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.720019] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.720019] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.720019] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-bf5a8cb7-b206-46b1-8d38-092266d7ca57" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.797575] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.797737] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.798453] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.798453] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.798453] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.798453] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 is going to be updated. [ 1082.829136] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.829350] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.829350] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.829552] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.829715] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.849432] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 in Status: IN_PROGRESS for 2s [ 1083.402907] env[69506]: INFO networking_nsxv3.common.synchronization [req-14c68d81-c121-4e77-bb51-7bd363a0152a req-e84301cb-88b7-4221-896e-a52f7a36bead service nova] Enqueued Resource ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca with Priority: HIGHEST for action security_group_rules [ 1083.403174] env[69506]: INFO networking_nsxv3.common.synchronization [req-14c68d81-c121-4e77-bb51-7bd363a0152a req-e84301cb-88b7-4221-896e-a52f7a36bead service nova] Enqueued Resource ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca with Priority: HIGHEST for action security_group_members [ 1083.403272] env[69506]: INFO networking_nsxv3.common.synchronization [req-14c68d81-c121-4e77-bb51-7bd363a0152a req-e84301cb-88b7-4221-896e-a52f7a36bead service nova] Enqueued Resource ID: bf5a8cb7-b206-46b1-8d38-092266d7ca57 with Priority: HIGHEST for action port [ 1083.403760] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca with Priority: HIGHEST for action security_group_rules [ 1083.403895] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca with Priority: HIGHEST for action security_group_members [ 1083.403996] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf5a8cb7-b206-46b1-8d38-092266d7ca57 with Priority: HIGHEST for action port [ 1083.404301] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0461c6a-1d2b-401e-b59f-af6eda84b6ca taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.404429] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.404499] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.404743] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.404824] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0461c6a-1d2b-401e-b59f-af6eda84b6ca',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.406318] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.406318] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.406455] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.406589] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.406767] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.406767] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.406869] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.406982] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.407085] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.407181] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0461c6a-1d2b-401e-b59f-af6eda84b6ca',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.407885] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf5a8cb7-b206-46b1-8d38-092266d7ca57 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.408015] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf5a8cb7-b206-46b1-8d38-092266d7ca57" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.408110] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf5a8cb7-b206-46b1-8d38-092266d7ca57" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.408239] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf5a8cb7-b206-46b1-8d38-092266d7ca57" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.408348] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf5a8cb7-b206-46b1-8d38-092266d7ca57',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.910506] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0461c6a-1d2b-401e-b59f-af6eda84b6ca',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.911715] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.911856] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.913237] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf5a8cb7-b206-46b1-8d38-092266d7ca57 with status ACTIVE [ 1083.913237] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.913237] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.913237] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.913237] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.913237] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.913237] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.913237] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.913237] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.913237] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.913237] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.913691] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.913691] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.913691] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.913691] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.913823] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.913853] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf5a8cb7-b206-46b1-8d38-092266d7ca57 is going to be updated. [ 1083.933425] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.933728] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.933845] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.934056] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.934208] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.934382] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf5a8cb7-b206-46b1-8d38-092266d7ca57" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.414464] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0461c6a-1d2b-401e-b59f-af6eda84b6ca',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.859226] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 in Status: SUCCESS [ 1084.859458] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.859682] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.859991] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.860228] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.860348] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.860411] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.860599] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.860680] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.860778] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.860899] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d9ed455-9c3f-46b7-9453-8a5f9cfb0580',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.916875] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.917076] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.917123] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.917352] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.917442] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.917546] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca is going to be created. [ 1084.938558] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.938751] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.938812] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.939016] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.939181] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.947441] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca in Status: UNINITIALIZED for 2s [ 1085.364357] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d9ed455-9c3f-46b7-9453-8a5f9cfb0580',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.701805] env[69506]: INFO networking_nsxv3.common.synchronization [req-307ca55a-98fd-46e4-a501-3272d33a5b16 req-91ca86b4-ca17-4f05-90d4-c3696d350021 tempest-ServersTestJSON-1801092994 tempest-ServersTestJSON-1801092994-project-member] Enqueued Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 1085.702394] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 1085.703130] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.703559] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.703638] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.703852] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.704036] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.704146] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.704278] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.704365] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.704451] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.704550] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.866490] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580: rpc.has_security_group_logging(os_id): False [ 1085.885031] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.885340] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.885489] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.885780] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.885928] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.886311] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.886458] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.886562] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.886798] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.886916] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.887473] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 is going to be updated. [ 1085.981014] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.981171] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.981243] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.981466] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.981614] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.995636] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 in Status: IN_PROGRESS for 2s [ 1086.062229] env[69506]: INFO networking_nsxv3.common.synchronization [req-4ee8ce46-c252-407d-b9e5-b2bade2e4220 req-9c9aa1b5-2b4e-45f9-8b3a-7c66f56833f3 tempest-AttachVolumeNegativeTest-402732870 tempest-AttachVolumeNegativeTest-402732870-project-member] Enqueued Resource ID: 7dc294f2-c118-4967-a208-cb40fa247a04 with Priority: HIGHEST for action security_group_members [ 1086.062797] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dc294f2-c118-4967-a208-cb40fa247a04 with Priority: HIGHEST for action security_group_members [ 1086.064439] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dc294f2-c118-4967-a208-cb40fa247a04 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.064439] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dc294f2-c118-4967-a208-cb40fa247a04" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.064439] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dc294f2-c118-4967-a208-cb40fa247a04" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.064439] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dc294f2-c118-4967-a208-cb40fa247a04" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.064439] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.064439] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.064439] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.064439] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.067759] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.067759] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dc294f2-c118-4967-a208-cb40fa247a04',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.210222] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.222350] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-54 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.222573] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-54" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.222720] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-54" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.223494] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-54" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.223838] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.224073] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.224218] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.224476] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.224632] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.224851] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1086.224971] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1086.225111] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1086.225273] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1086.226807] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1086.226953] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1086.227118] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1086.253578] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1086.253578] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1086.253578] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1086.253578] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-54" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.253578] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-673dc993-9087-4cd8-88d2-dd662d7868c9 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.253578] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-673dc993-9087-4cd8-88d2-dd662d7868c9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.253578] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-673dc993-9087-4cd8-88d2-dd662d7868c9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.254039] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-673dc993-9087-4cd8-88d2-dd662d7868c9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.254039] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('673dc993-9087-4cd8-88d2-dd662d7868c9',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.570549] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.570910] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.570910] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.571157] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.591961] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.592209] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.592305] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.592374] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.592560] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.592664] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.592800] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dc294f2-c118-4967-a208-cb40fa247a04 is going to be updated. [ 1086.619953] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.620123] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.620176] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.620377] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.620619] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.629228] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dc294f2-c118-4967-a208-cb40fa247a04 in Status: IN_PROGRESS for 2s [ 1086.712749] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.756185] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.756185] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.756281] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.756540] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.756727] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.756908] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 673dc993-9087-4cd8-88d2-dd662d7868c9 not found, creating... [ 1086.757241] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.758402] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.758402] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.758402] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.758402] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.758402] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.758605] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.758633] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.758839] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.759131] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.759131] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 673dc993-9087-4cd8-88d2-dd662d7868c9 is going to be created. [ 1086.782067] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.784503] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.784503] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.784503] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.784503] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.784503] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-673dc993-9087-4cd8-88d2-dd662d7868c9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.957597] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca in Status: SUCCESS [ 1086.957892] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.958106] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.958385] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.958617] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.958721] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.958787] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.958940] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.959036] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.959124] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.959212] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0461c6a-1d2b-401e-b59f-af6eda84b6ca',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.217463] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.217626] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.217741] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.217922] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.218024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.218128] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc is going to be updated. [ 1087.261035] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.261035] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.261231] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.261289] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.261451] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.271580] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: IN_PROGRESS for 2s [ 1087.461671] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.462507] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.462998] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.463272] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.463920] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.464205] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.464660] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.464876] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.465350] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.467295] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.467519] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.467657] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.467802] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.467971] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.468135] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.468233] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.468297] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.468445] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.468540] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.468633] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.468726] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0461c6a-1d2b-401e-b59f-af6eda84b6ca',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.621194] env[69506]: INFO networking_nsxv3.common.synchronization [req-307ca55a-98fd-46e4-a501-3272d33a5b16 req-8d9db579-8726-460e-9d34-d6d4b3d26703 service nova] Enqueued Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_rules [ 1087.622798] env[69506]: INFO networking_nsxv3.common.synchronization [req-307ca55a-98fd-46e4-a501-3272d33a5b16 req-8d9db579-8726-460e-9d34-d6d4b3d26703 service nova] Enqueued Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 1087.623640] env[69506]: INFO networking_nsxv3.common.synchronization [req-307ca55a-98fd-46e4-a501-3272d33a5b16 req-8d9db579-8726-460e-9d34-d6d4b3d26703 service nova] Enqueued Resource ID: 673dc993-9087-4cd8-88d2-dd662d7868c9 with Priority: HIGHEST for action port [ 1087.624303] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_rules [ 1087.625368] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 1087.625562] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 673dc993-9087-4cd8-88d2-dd662d7868c9 with Priority: HIGHEST for action port [ 1087.625891] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.626015] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.626095] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.626310] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.626379] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.627305] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.627417] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.627602] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-673dc993-9087-4cd8-88d2-dd662d7868c9 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.627694] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-673dc993-9087-4cd8-88d2-dd662d7868c9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.627756] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-673dc993-9087-4cd8-88d2-dd662d7868c9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.627944] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-673dc993-9087-4cd8-88d2-dd662d7868c9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.628028] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('673dc993-9087-4cd8-88d2-dd662d7868c9',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.973334] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0461c6a-1d2b-401e-b59f-af6eda84b6ca: rpc.has_security_group_logging(os_id): False [ 1087.995311] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.995464] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.995554] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.995813] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.997152] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.997152] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.997152] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.997152] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.997152] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.997152] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.997152] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.997152] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.997152] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.997152] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.997152] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.997692] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.997692] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.997692] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.997692] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.997692] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.997692] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca is going to be created. [ 1088.011841] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 in Status: SUCCESS [ 1088.011841] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.052799] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.052977] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.053101] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.053349] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.053544] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.065060] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca in Status: IN_PROGRESS for 2s [ 1088.129943] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.130093] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.134939] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 673dc993-9087-4cd8-88d2-dd662d7868c9 with status ACTIVE [ 1088.134939] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.134939] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.134939] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.135193] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.135300] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.135415] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.135508] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.135565] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.135707] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.135991] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.135991] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.136105] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.136105] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.136232] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.136304] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.136434] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 673dc993-9087-4cd8-88d2-dd662d7868c9 is going to be updated. [ 1088.178754] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.178932] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.179067] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.179356] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.179554] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.179763] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-673dc993-9087-4cd8-88d2-dd662d7868c9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.638679] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dc294f2-c118-4967-a208-cb40fa247a04 in Status: SUCCESS [ 1088.638679] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dc294f2-c118-4967-a208-cb40fa247a04 deletion is rescheduled due to dependency. [ 1088.638789] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dc294f2-c118-4967-a208-cb40fa247a04" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.284254] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: SUCCESS [ 1089.284539] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.284655] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.284899] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.285090] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.285211] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.285274] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.285430] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.285515] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.285746] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.563450] env[69506]: INFO networking_nsxv3.common.synchronization [None req-5df89a66-bac3-43b3-9656-b4857fd9601d tempest-AttachInterfacesTestJSON-2055467997 tempest-AttachInterfacesTestJSON-2055467997-project-member] Enqueued Resource ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 with Priority: HIGHEST for action security_group_members [ 1089.564058] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 with Priority: HIGHEST for action security_group_members [ 1089.564716] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f946d66-543a-40be-9347-81d7eb4f4e31 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.564862] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.564927] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.565137] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.565305] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.565407] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.565467] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.565615] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.565699] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.565791] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.789213] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.071212] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.071354] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.071422] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.071671] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.071760] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.072125] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.072125] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.072125] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.075032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.075032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.075032] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 is going to be updated. [ 1090.076788] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca in Status: SUCCESS [ 1090.077017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.103520] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.103683] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.103725] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.103938] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.104094] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.169107] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 in Status: IN_PROGRESS for 2s [ 1090.292261] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.798597] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.798809] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.798899] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.799167] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.799279] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.799446] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc is going to be updated. [ 1090.829814] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.830064] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.830130] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.830388] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.830471] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.840113] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: IN_PROGRESS for 2s [ 1092.181263] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 in Status: SUCCESS [ 1092.181263] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 deletion is rescheduled due to dependency. [ 1092.181263] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.397116] env[69506]: INFO networking_nsxv3.common.synchronization [None req-5253e9bf-95ab-4e48-b2fd-34479051e52a None None] Enqueued Resource ID: ebdb423c-a2c9-48b1-a9d2-a1195b8d06a9 with Priority: HIGHEST for action port [ 1092.397805] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebdb423c-a2c9-48b1-a9d2-a1195b8d06a9 with Priority: HIGHEST for action port [ 1092.398017] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebdb423c-a2c9-48b1-a9d2-a1195b8d06a9 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.398137] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebdb423c-a2c9-48b1-a9d2-a1195b8d06a9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.398322] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebdb423c-a2c9-48b1-a9d2-a1195b8d06a9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.398532] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebdb423c-a2c9-48b1-a9d2-a1195b8d06a9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.398676] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebdb423c-a2c9-48b1-a9d2-a1195b8d06a9',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.640244] env[69506]: INFO networking_nsxv3.common.synchronization [req-634124ea-bf18-4758-95a4-c1b55dbe3563 req-73156bdb-45fd-4a68-9285-7a9559aaf449 tempest-ServerRescueNegativeTestJSON-1844285858 tempest-ServerRescueNegativeTestJSON-1844285858-project-member] Enqueued Resource ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 with Priority: HIGHEST for action security_group_members [ 1092.641226] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 with Priority: HIGHEST for action security_group_members [ 1092.641226] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-76ac020a-e732-4afe-ace5-7bd4b6ea9072 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.641360] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.645099] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.645099] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.645099] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.645099] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.645099] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.645099] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.645099] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.645099] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76ac020a-e732-4afe-ace5-7bd4b6ea9072',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.849748] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: SUCCESS [ 1092.850995] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.851273] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.851668] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.851871] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.852214] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.852214] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.852389] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.852546] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.852725] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.852781] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.900349] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ebdb423c-a2c9-48b1-a9d2-a1195b8d06a9 [ 1092.900602] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.900740] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.900805] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.901095] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.901140] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.901226] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ebdb423c-a2c9-48b1-a9d2-a1195b8d06a9 already deleted. [ 1092.901309] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebdb423c-a2c9-48b1-a9d2-a1195b8d06a9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.146196] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.146196] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.146196] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.146196] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.169214] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.169214] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.169214] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.169214] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.169214] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.169214] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.169214] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 is going to be updated. [ 1093.229141] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.229141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.229141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.229141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.229141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.243677] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 in Status: IN_PROGRESS for 2s [ 1093.356934] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.356934] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.356934] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.357219] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.357219] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.357732] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.357732] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.357732] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.357732] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.357732] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.357891] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.357941] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.357969] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.358113] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.358290] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.358351] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.358390] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.358514] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.358596] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.358674] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.358762] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.862942] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc: rpc.has_security_group_logging(os_id): False [ 1093.881043] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.881232] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.881318] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.881640] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.881733] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.882019] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.882147] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.882295] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.882405] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.882504] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.882745] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.882933] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.882933] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.887764] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.887764] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.887764] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.887764] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.887764] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.887948] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.887948] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.888012] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc is going to be updated. [ 1093.950181] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.950326] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.950414] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.950681] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.950827] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.965615] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: IN_PROGRESS for 2s [ 1094.327421] env[69506]: INFO networking_nsxv3.common.synchronization [None req-d5cf4379-0956-4051-ab0e-80307bda834d tempest-AttachVolumeNegativeTest-402732870 tempest-AttachVolumeNegativeTest-402732870-project-member] Enqueued Resource ID: c29a3314-8167-42dc-9e04-3dc4cb967960 with Priority: HIGHEST for action security_group_rules [ 1094.329020] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c29a3314-8167-42dc-9e04-3dc4cb967960 with Priority: HIGHEST for action security_group_rules [ 1094.329020] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c29a3314-8167-42dc-9e04-3dc4cb967960 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.329020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c29a3314-8167-42dc-9e04-3dc4cb967960" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.329020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c29a3314-8167-42dc-9e04-3dc4cb967960" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.329438] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c29a3314-8167-42dc-9e04-3dc4cb967960" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.329766] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c29a3314-8167-42dc-9e04-3dc4cb967960',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.403029] env[69506]: INFO networking_nsxv3.common.synchronization [None req-3d502f10-8f71-4cb9-b242-1c1f1b164029 tempest-AttachVolumeNegativeTest-402732870 tempest-AttachVolumeNegativeTest-402732870-project-member] Enqueued Resource ID: c29a3314-8167-42dc-9e04-3dc4cb967960 with Priority: HIGHEST for action security_group_rules [ 1094.403029] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c29a3314-8167-42dc-9e04-3dc4cb967960 with Priority: HIGHEST for action security_group_rules [ 1094.403731] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c29a3314-8167-42dc-9e04-3dc4cb967960 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.403994] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c29a3314-8167-42dc-9e04-3dc4cb967960" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.587975] env[69506]: INFO networking_nsxv3.common.synchronization [None req-79148a06-87fb-4e6c-a014-e6c84a9a460f None None] Enqueued Resource ID: 4f0e21df-eabc-41af-9cb9-4cf4a4c3dc6e with Priority: HIGHEST for action port [ 1094.589035] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f0e21df-eabc-41af-9cb9-4cf4a4c3dc6e with Priority: HIGHEST for action port [ 1094.589035] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f0e21df-eabc-41af-9cb9-4cf4a4c3dc6e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.589035] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f0e21df-eabc-41af-9cb9-4cf4a4c3dc6e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.589442] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f0e21df-eabc-41af-9cb9-4cf4a4c3dc6e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.589764] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f0e21df-eabc-41af-9cb9-4cf4a4c3dc6e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.591015] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f0e21df-eabc-41af-9cb9-4cf4a4c3dc6e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.850464] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.850666] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.850776] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.851010] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.851107] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.851202] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c29a3314-8167-42dc-9e04-3dc4cb967960 already deleted. [ 1094.851289] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c29a3314-8167-42dc-9e04-3dc4cb967960" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.852020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c29a3314-8167-42dc-9e04-3dc4cb967960" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.852211] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c29a3314-8167-42dc-9e04-3dc4cb967960" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.852304] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c29a3314-8167-42dc-9e04-3dc4cb967960',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.094677] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4f0e21df-eabc-41af-9cb9-4cf4a4c3dc6e [ 1095.095598] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.096225] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.096458] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.097225] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.098015] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.098227] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4f0e21df-eabc-41af-9cb9-4cf4a4c3dc6e already deleted. [ 1095.098426] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f0e21df-eabc-41af-9cb9-4cf4a4c3dc6e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.253554] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 in Status: SUCCESS [ 1095.253750] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 deletion is rescheduled due to dependency. [ 1095.253873] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.373994] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.373994] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.373994] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.373994] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.373994] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.373994] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c29a3314-8167-42dc-9e04-3dc4cb967960 already deleted. [ 1095.374396] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c29a3314-8167-42dc-9e04-3dc4cb967960" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.807406] env[69506]: INFO networking_nsxv3.common.synchronization [req-9326c628-c440-475c-851c-95339ad7cc3a req-f04d1f46-ded4-4f71-b3cb-ffa0c767a852 tempest-DeleteServersTestJSON-1880805458 tempest-DeleteServersTestJSON-1880805458-project-member] Enqueued Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_members [ 1095.807999] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_members [ 1095.808316] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.808483] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.808483] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.808686] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.808840] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.808960] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.809053] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.809135] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.809217] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.809311] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.982649] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: SUCCESS [ 1095.982649] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.311641] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.311839] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.311839] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.312102] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.312201] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.312400] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.312503] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.312565] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.312719] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.312797] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.312882] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d is going to be updated. [ 1096.400452] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.400780] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.400780] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.400900] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.401049] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.409439] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: IN_PROGRESS for 2s [ 1098.421123] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: SUCCESS [ 1098.421498] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d deletion is rescheduled due to dependency. [ 1098.421498] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.042147] env[69506]: INFO networking_nsxv3.common.synchronization [req-babd38c1-f08c-484b-be36-197381498086 req-099d2f88-a884-4e59-8422-36ba675a49db tempest-ServersTestJSON-1801092994 tempest-ServersTestJSON-1801092994-project-member] Enqueued Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 1099.042660] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 1099.043038] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.043130] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.043180] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.043360] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.043507] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.043602] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.043662] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.043807] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.043892] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.043981] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.546422] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.746835] env[69506]: INFO networking_nsxv3.common.synchronization [req-0966e9a0-29bd-437c-a424-ef350318ebdd req-b729f7aa-b161-4130-a10f-5ca16aea1425 tempest-ServersNegativeTestJSON-1250642852 tempest-ServersNegativeTestJSON-1250642852-project-member] Enqueued Resource ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca with Priority: HIGHEST for action security_group_members [ 1099.747244] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca with Priority: HIGHEST for action security_group_members [ 1099.747650] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.747782] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.747854] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.748427] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.748633] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.749035] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.749146] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.749331] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.749454] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.749552] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0461c6a-1d2b-401e-b59f-af6eda84b6ca',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.049056] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.056886] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-324 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.057110] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-324" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.057346] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-324" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.057513] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-324" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.057771] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.057957] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.058140] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.058291] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.058433] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.058673] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1100.058827] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1100.058908] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1100.059743] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1100.059950] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1100.060099] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1100.060295] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1100.080137] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1100.080313] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1100.080971] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1100.080971] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-324" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.081118] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-296e2511-a37e-4f22-96d3-5dc5f562decb taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.081204] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-296e2511-a37e-4f22-96d3-5dc5f562decb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.081332] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-296e2511-a37e-4f22-96d3-5dc5f562decb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.081637] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-296e2511-a37e-4f22-96d3-5dc5f562decb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.081868] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('296e2511-a37e-4f22-96d3-5dc5f562decb',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.251548] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0461c6a-1d2b-401e-b59f-af6eda84b6ca',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.552026] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.552337] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.552337] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.552472] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.552608] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.552759] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc is going to be updated. [ 1100.579860] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.579860] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.579860] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.580111] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.580202] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.584832] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.585031] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.585252] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.585383] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.585524] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.585677] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 296e2511-a37e-4f22-96d3-5dc5f562decb not found, creating... [ 1100.585926] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.586097] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.586218] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.586426] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.586563] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.586839] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.586997] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.587129] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.587334] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.587482] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.587625] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 296e2511-a37e-4f22-96d3-5dc5f562decb is going to be created. [ 1100.588947] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: IN_PROGRESS for 2s [ 1100.605596] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.605812] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.605942] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.606220] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.606444] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.606662] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-296e2511-a37e-4f22-96d3-5dc5f562decb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.753589] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0461c6a-1d2b-401e-b59f-af6eda84b6ca',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.059810] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.059982] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.060077] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.060328] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.060548] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.256693] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.256693] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.256693] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.256693] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.256693] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.256902] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca is going to be updated. [ 1101.287529] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.287682] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.287753] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.288014] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.288179] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.297541] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca in Status: IN_PROGRESS for 2s [ 1101.309882] env[69506]: INFO networking_nsxv3.common.synchronization [req-0966e9a0-29bd-437c-a424-ef350318ebdd req-6beff672-3a01-459c-952f-e79e8981621e service nova] Enqueued Resource ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca with Priority: HIGHEST for action security_group_rules [ 1101.310067] env[69506]: INFO networking_nsxv3.common.synchronization [req-0966e9a0-29bd-437c-a424-ef350318ebdd req-6beff672-3a01-459c-952f-e79e8981621e service nova] Enqueued Resource ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca with Priority: HIGHEST for action security_group_members [ 1101.310204] env[69506]: INFO networking_nsxv3.common.synchronization [req-0966e9a0-29bd-437c-a424-ef350318ebdd req-6beff672-3a01-459c-952f-e79e8981621e service nova] Enqueued Resource ID: 296e2511-a37e-4f22-96d3-5dc5f562decb with Priority: HIGHEST for action port [ 1101.310434] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca with Priority: HIGHEST for action security_group_rules [ 1101.310562] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca with Priority: HIGHEST for action security_group_members [ 1101.310659] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 296e2511-a37e-4f22-96d3-5dc5f562decb with Priority: HIGHEST for action port [ 1101.311243] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0461c6a-1d2b-401e-b59f-af6eda84b6ca taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.311356] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.311553] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.311786] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.311876] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0461c6a-1d2b-401e-b59f-af6eda84b6ca',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.312694] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.313284] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.313284] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-296e2511-a37e-4f22-96d3-5dc5f562decb taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.313284] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-296e2511-a37e-4f22-96d3-5dc5f562decb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.313284] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-296e2511-a37e-4f22-96d3-5dc5f562decb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.313284] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-296e2511-a37e-4f22-96d3-5dc5f562decb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.313583] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('296e2511-a37e-4f22-96d3-5dc5f562decb',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.562698] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.815263] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.815457] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.815506] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 296e2511-a37e-4f22-96d3-5dc5f562decb with status ACTIVE [ 1101.815683] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.815790] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.815858] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.816092] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.816186] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.816550] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.816550] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.816550] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.816652] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.816719] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.816901] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.816995] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.817068] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.817208] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.817285] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.817368] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 296e2511-a37e-4f22-96d3-5dc5f562decb is going to be updated. [ 1101.839073] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.839248] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.839291] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.839471] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.839595] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.839751] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-296e2511-a37e-4f22-96d3-5dc5f562decb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.064852] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.567199] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1102.567493] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1102.598564] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: SUCCESS [ 1102.598809] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.309441] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca in Status: SUCCESS [ 1103.309441] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.309620] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.309873] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.310115] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.310294] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.310450] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.310533] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.310677] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.310782] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0461c6a-1d2b-401e-b59f-af6eda84b6ca',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.401772] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.401772] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.401772] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.401772] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.412643] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1103.413533] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.414598] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1103.450205] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.450493] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.450493] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.450608] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.463401] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.464154] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1103.464266] env[69506]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69506) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1103.464366] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1103.507110] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.507279] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.507279] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.507475] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.508928] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.509113] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1103.603928] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.604310] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.604310] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.604552] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.604841] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.605126] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1103.672365] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.672626] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.672626] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.672821] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.673140] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.673460] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:47. [ 1103.673561] env[69506]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'458c7186-d79f-4548-a2a0-95db0abbb880', '1bceaf9d-1c44-4281-83d2-4109ac0771c7', 'f7dad645-1b67-495c-8fe3-ab50c7737c6c', '753050ac-8ed4-4825-8136-44279adacb0f', '38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d', 'd0461c6a-1d2b-401e-b59f-af6eda84b6ca', '0bc29505-f5b4-4554-85b9-541273bd8da3', '77834f91-37e7-4feb-86e1-583e68d3d852', '05c6d62a-58f1-418b-815e-8b3f7f5cd5eb', '0210561b-43ff-434b-97ef-339a5d85a2a9', '7d9ed455-9c3f-46b7-9453-8a5f9cfb0580', 'a6908af9-f839-40b2-9ca2-1fd554ee1d78', '7dc294f2-c118-4967-a208-cb40fa247a04', '17f09989-f208-4cef-8aea-94e818aa9a91', '2d66cc0b-bd33-47cb-9365-01d39638c887', 'd8ff5e5b-5797-4254-b957-602d11e125dd', 'c0818539-e942-4d2b-a340-3442e08309ce', '23c9b5f8-1cff-4d68-a385-35487b841eb9', '96b2c90a-a7a0-4dcb-8212-5e459d8d4793', '76ac020a-e732-4afe-ace5-7bd4b6ea9072', '706a5462-e893-428d-beb2-737cbec00439', 'b50d66d8-0bc1-42fe-b025-b6e5287fc3df', '479009cc-bfe1-4ddc-a0f7-70c7b96b33dc', '0a27cb9c-bb13-44cb-a531-49610a94a36e', '64557eb9-9b83-42ab-99e4-278f5711a22e', '5387ebf9-b56f-4308-969a-3aa715cad9da', 'd52cf5b6-2860-4667-8ade-9e0529358ed1', 'fca9cd47-c1fb-4023-8f12-fa1b22a98fd8', '78caaaf6-868f-4043-93dd-d9a75a05d023', '3f946d66-543a-40be-9347-81d7eb4f4e31', '1ba3a620-9fd8-44d2-8d21-20dfc5b1648d', '20940711-36df-48c2-b8ae-df2cfecaebc8', 'eee25a0e-a423-45cd-80e8-327029ae7dc4', '7e307bb5-2c7b-4260-88ec-90f13f2de5d2', '7d0db323-2ed4-4f6a-a30a-405b16133cb2', 'c141011f-1c58-45cb-b73c-ad882255b77a', '823c6679-501c-4ec2-9d9f-f49b7cc1205d', '40ac1d9f-7f09-4603-ba34-b3f5910e1da2', '008501d4-938b-4336-9c1d-ef3665f7d09d', 'cb920054-1c0f-4a74-aad1-8ca7ce036993', '65fb79f7-95e7-4be9-b5bb-64c57bc42333', '56c2fe94-2993-4f31-a331-b0611a88cec2', '9ce980c1-0c92-48ab-930f-2537a5f82269', '9f130eeb-c453-4570-b0fe-743f47890102', '9e830a1e-918a-49a7-b725-f68307282e6e', '39f6b94d-d05c-4309-8b06-e27ba3215b09', '0745f36a-3469-4c49-9c0f-8111fe1bd802'} {{(pid=69506) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1103.673677] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1103.692142] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.692390] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.692390] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.692556] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.692642] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.692751] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1103.692824] env[69506]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69506) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1103.692896] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1103.813491] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0461c6a-1d2b-401e-b59f-af6eda84b6ca',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.819774] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.819965] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.820062] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.820314] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.821416] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.821674] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1103.821756] env[69506]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69506) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1103.821827] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1103.821958] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1103.821958] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/47 resources of Type:Security Group Rules [ 1103.822068] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 458c7186-d79f-4548-a2a0-95db0abbb880 with Priority: HIGH for action security_group_rules [ 1103.822130] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1bceaf9d-1c44-4281-83d2-4109ac0771c7 with Priority: HIGH for action security_group_rules [ 1103.823043] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f7dad645-1b67-495c-8fe3-ab50c7737c6c with Priority: HIGH for action security_group_rules [ 1103.823043] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 753050ac-8ed4-4825-8136-44279adacb0f with Priority: HIGH for action security_group_rules [ 1103.823043] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d with Priority: HIGH for action security_group_rules [ 1103.823043] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca with Priority: HIGH for action security_group_rules [ 1103.823043] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 with Priority: HIGH for action security_group_rules [ 1103.823043] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 77834f91-37e7-4feb-86e1-583e68d3d852 with Priority: HIGH for action security_group_rules [ 1103.823043] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 05c6d62a-58f1-418b-815e-8b3f7f5cd5eb with Priority: HIGH for action security_group_rules [ 1103.823043] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0210561b-43ff-434b-97ef-339a5d85a2a9 with Priority: HIGH for action security_group_rules [ 1103.823043] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 with Priority: HIGH for action security_group_rules [ 1103.823043] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 with Priority: HIGH for action security_group_rules [ 1103.823043] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7dc294f2-c118-4967-a208-cb40fa247a04 with Priority: HIGH for action security_group_rules [ 1103.823043] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 17f09989-f208-4cef-8aea-94e818aa9a91 with Priority: HIGH for action security_group_rules [ 1103.823043] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2d66cc0b-bd33-47cb-9365-01d39638c887 with Priority: HIGH for action security_group_rules [ 1103.823043] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d8ff5e5b-5797-4254-b957-602d11e125dd with Priority: HIGH for action security_group_rules [ 1103.823043] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c0818539-e942-4d2b-a340-3442e08309ce with Priority: HIGH for action security_group_rules [ 1103.823043] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 23c9b5f8-1cff-4d68-a385-35487b841eb9 with Priority: HIGH for action security_group_rules [ 1103.823546] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 with Priority: HIGH for action security_group_rules [ 1103.823546] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 with Priority: HIGH for action security_group_rules [ 1103.823546] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.325232] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0461c6a-1d2b-401e-b59f-af6eda84b6ca',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.828087] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.828446] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.828446] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.828513] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.828585] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.828694] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca is going to be updated. [ 1104.854907] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.854907] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.854907] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.854907] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.854907] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.862912] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca in Status: IN_PROGRESS for 2s [ 1106.311734] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1106.312075] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=2 [ 1106.312075] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 458c7186-d79f-4548-a2a0-95db0abbb880 with Priority: HIGH for action security_group_rules [ 1106.312183] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7dad645-1b67-495c-8fe3-ab50c7737c6c with Priority: HIGH for action security_group_rules [ 1106.312240] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 with Priority: HIGH for action security_group_rules [ 1106.312326] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d66cc0b-bd33-47cb-9365-01d39638c887 with Priority: HIGH for action security_group_rules [ 1106.312422] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 with Priority: HIGH for action security_group_rules [ 1106.312515] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 with Priority: HIGH for action security_group_rules [ 1106.312606] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23c9b5f8-1cff-4d68-a385-35487b841eb9 with Priority: HIGH for action security_group_rules [ 1106.312694] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0818539-e942-4d2b-a340-3442e08309ce with Priority: HIGH for action security_group_rules [ 1106.312790] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17f09989-f208-4cef-8aea-94e818aa9a91 with Priority: HIGH for action security_group_rules [ 1106.312881] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8ff5e5b-5797-4254-b957-602d11e125dd with Priority: HIGH for action security_group_rules [ 1106.312945] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dc294f2-c118-4967-a208-cb40fa247a04 with Priority: HIGH for action security_group_rules [ 1106.313045] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 with Priority: HIGH for action security_group_rules [ 1106.313152] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 with Priority: HIGH for action security_group_rules [ 1106.313257] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0210561b-43ff-434b-97ef-339a5d85a2a9 with Priority: HIGH for action security_group_rules [ 1106.313357] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05c6d62a-58f1-418b-815e-8b3f7f5cd5eb with Priority: HIGH for action security_group_rules [ 1106.313442] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca with Priority: HIGH for action security_group_rules [ 1106.313530] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77834f91-37e7-4feb-86e1-583e68d3d852 with Priority: HIGH for action security_group_rules [ 1106.313618] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d with Priority: HIGH for action security_group_rules [ 1106.313705] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bceaf9d-1c44-4281-83d2-4109ac0771c7 with Priority: HIGH for action security_group_rules [ 1106.313793] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 753050ac-8ed4-4825-8136-44279adacb0f with Priority: HIGH for action security_group_rules [ 1106.314159] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-458c7186-d79f-4548-a2a0-95db0abbb880 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.314288] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.314353] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.314561] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.314642] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('458c7186-d79f-4548-a2a0-95db0abbb880',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.316028] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7dad645-1b67-495c-8fe3-ab50c7737c6c taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.316028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7dad645-1b67-495c-8fe3-ab50c7737c6c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.316179] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7dad645-1b67-495c-8fe3-ab50c7737c6c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.316268] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7dad645-1b67-495c-8fe3-ab50c7737c6c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.316347] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7dad645-1b67-495c-8fe3-ab50c7737c6c',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.317101] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0bc29505-f5b4-4554-85b9-541273bd8da3 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.317217] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.317271] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.317601] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.317601] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0bc29505-f5b4-4554-85b9-541273bd8da3',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.318309] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d66cc0b-bd33-47cb-9365-01d39638c887 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.318309] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d66cc0b-bd33-47cb-9365-01d39638c887" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.318309] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d66cc0b-bd33-47cb-9365-01d39638c887" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.318468] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d66cc0b-bd33-47cb-9365-01d39638c887" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.318527] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d66cc0b-bd33-47cb-9365-01d39638c887',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.319345] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76ac020a-e732-4afe-ace5-7bd4b6ea9072 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.319471] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.319471] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.319778] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.319778] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76ac020a-e732-4afe-ace5-7bd4b6ea9072',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.320949] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.320949] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.321113] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.321113] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.321206] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('96b2c90a-a7a0-4dcb-8212-5e459d8d4793',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.321920] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23c9b5f8-1cff-4d68-a385-35487b841eb9 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.322050] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23c9b5f8-1cff-4d68-a385-35487b841eb9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.322095] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23c9b5f8-1cff-4d68-a385-35487b841eb9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.322244] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23c9b5f8-1cff-4d68-a385-35487b841eb9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.322314] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23c9b5f8-1cff-4d68-a385-35487b841eb9',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.323262] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0818539-e942-4d2b-a340-3442e08309ce taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.323354] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0818539-e942-4d2b-a340-3442e08309ce" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.323391] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0818539-e942-4d2b-a340-3442e08309ce" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.323542] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0818539-e942-4d2b-a340-3442e08309ce" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.323612] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0818539-e942-4d2b-a340-3442e08309ce',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.324338] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17f09989-f208-4cef-8aea-94e818aa9a91 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.324434] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17f09989-f208-4cef-8aea-94e818aa9a91" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.324507] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17f09989-f208-4cef-8aea-94e818aa9a91" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.324658] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17f09989-f208-4cef-8aea-94e818aa9a91" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.324730] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17f09989-f208-4cef-8aea-94e818aa9a91',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.325623] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8ff5e5b-5797-4254-b957-602d11e125dd taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.325799] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8ff5e5b-5797-4254-b957-602d11e125dd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.325799] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8ff5e5b-5797-4254-b957-602d11e125dd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.325939] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8ff5e5b-5797-4254-b957-602d11e125dd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.326010] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8ff5e5b-5797-4254-b957-602d11e125dd',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.326676] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7dc294f2-c118-4967-a208-cb40fa247a04 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.326773] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7dc294f2-c118-4967-a208-cb40fa247a04" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.326844] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7dc294f2-c118-4967-a208-cb40fa247a04" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.326971] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7dc294f2-c118-4967-a208-cb40fa247a04" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.327041] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7dc294f2-c118-4967-a208-cb40fa247a04',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.327701] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6908af9-f839-40b2-9ca2-1fd554ee1d78 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.327791] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.327862] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.328017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.328293] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6908af9-f839-40b2-9ca2-1fd554ee1d78',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.328763] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.328973] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.329057] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.329283] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.329283] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d9ed455-9c3f-46b7-9453-8a5f9cfb0580',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.329909] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0210561b-43ff-434b-97ef-339a5d85a2a9 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.330044] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0210561b-43ff-434b-97ef-339a5d85a2a9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.330090] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0210561b-43ff-434b-97ef-339a5d85a2a9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.330262] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0210561b-43ff-434b-97ef-339a5d85a2a9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.330310] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0210561b-43ff-434b-97ef-339a5d85a2a9',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.331013] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.331128] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.331189] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.331340] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.331406] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05c6d62a-58f1-418b-815e-8b3f7f5cd5eb',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.332087] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0461c6a-1d2b-401e-b59f-af6eda84b6ca taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.332220] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.332358] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77834f91-37e7-4feb-86e1-583e68d3d852 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.332457] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.332521] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.332788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.332788] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77834f91-37e7-4feb-86e1-583e68d3d852',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.333571] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.333747] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.333747] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.333930] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.333963] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.334611] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bceaf9d-1c44-4281-83d2-4109ac0771c7 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.334717] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.334768] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.334908] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.334981] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bceaf9d-1c44-4281-83d2-4109ac0771c7',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.335628] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-753050ac-8ed4-4825-8136-44279adacb0f taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.335720] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-753050ac-8ed4-4825-8136-44279adacb0f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.335785] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-753050ac-8ed4-4825-8136-44279adacb0f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.335926] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-753050ac-8ed4-4825-8136-44279adacb0f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.336030] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('753050ac-8ed4-4825-8136-44279adacb0f',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.356668] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.356842] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.356886] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.357112] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.373899] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.374029] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23c9b5f8-1cff-4d68-a385-35487b841eb9 is going to be deleted. [ 1106.418806] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.419020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.419020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.419277] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.419370] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.419500] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23c9b5f8-1cff-4d68-a385-35487b841eb9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.846589] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.846839] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.846937] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.847192] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.847430] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.847597] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.847746] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.848037] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.848135] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.848224] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.848315] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d9ed455-9c3f-46b7-9453-8a5f9cfb0580',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.849229] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.849337] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.849408] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.849558] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.849700] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.849794] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.849861] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.850081] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.850164] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.850251] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.850331] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('96b2c90a-a7a0-4dcb-8212-5e459d8d4793',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.892555] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.892698] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.892769] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.892968] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.900093] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.900691] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.900910] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.901000] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.901696] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.901793] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.902478] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.902576] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.904721] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca in Status: SUCCESS [ 1106.904906] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.905067] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.905243] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.905390] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.905490] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.905554] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.905694] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.905775] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.905859] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.905947] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0461c6a-1d2b-401e-b59f-af6eda84b6ca',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.907263] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.907360] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.908206] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.908301] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.908981] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.909091] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.909784] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.909878] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.910548] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.910658] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.911332] env[69506]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1106.911710] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.911806] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.912420] env[69506]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1106.912768] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.912859] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.913484] env[69506]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1106.913839] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.913942] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.914584] env[69506]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1106.914941] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.915055] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.915601] env[69506]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1106.915947] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.916234] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.917249] env[69506]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1106.917620] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.917732] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.918451] env[69506]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1106.918798] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.918903] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 458c7186-d79f-4548-a2a0-95db0abbb880 is going to be deleted. [ 1106.920020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.920200] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.937089] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.937473] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d is going to be deleted. [ 1106.937989] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.938199] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.954718] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.954843] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7dc294f2-c118-4967-a208-cb40fa247a04 is going to be deleted. [ 1106.955776] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.956027] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.971348] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.971348] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.977470] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.977470] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05c6d62a-58f1-418b-815e-8b3f7f5cd5eb is going to be deleted. [ 1106.978459] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.978459] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.979389] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.979489] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.015965] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.016142] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0bc29505-f5b4-4554-85b9-541273bd8da3 is going to be deleted. [ 1107.017040] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.017356] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.019694] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.020053] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.041503] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.041633] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6908af9-f839-40b2-9ca2-1fd554ee1d78 is going to be deleted. [ 1107.042695] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.042783] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.074843] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.074968] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.116389] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.116549] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d66cc0b-bd33-47cb-9365-01d39638c887 is going to be deleted. [ 1107.117458] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.117669] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.147269] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.147395] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.148619] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.148745] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.168940] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.169162] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76ac020a-e732-4afe-ace5-7bd4b6ea9072 is going to be deleted. [ 1107.170105] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.170320] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.209598] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.209779] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.226947] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.227114] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8ff5e5b-5797-4254-b957-602d11e125dd is going to be deleted. [ 1107.227973] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.228284] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.263737] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.263888] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bceaf9d-1c44-4281-83d2-4109ac0771c7 is going to be deleted. [ 1107.264824] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.265062] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.337745] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.338212] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17f09989-f208-4cef-8aea-94e818aa9a91 is going to be deleted. [ 1107.338767] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.338970] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.340696] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.340811] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.362523] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('96b2c90a-a7a0-4dcb-8212-5e459d8d4793',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.363727] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d9ed455-9c3f-46b7-9453-8a5f9cfb0580',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.375753] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.375753] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.378504] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.378504] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.397069] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.397069] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0210561b-43ff-434b-97ef-339a5d85a2a9 is going to be deleted. [ 1107.397706] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.397960] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.408921] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.409114] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.409114] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.409335] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.409512] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.409604] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.409669] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.409819] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.409907] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.409998] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.410157] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.410250] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.410312] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.410452] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.410616] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.410709] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.410787] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.411014] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.411186] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.411322] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.411456] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0461c6a-1d2b-401e-b59f-af6eda84b6ca',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.426194] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.426324] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77834f91-37e7-4feb-86e1-583e68d3d852 is going to be deleted. [ 1107.427377] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.427566] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.507103] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.507253] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 753050ac-8ed4-4825-8136-44279adacb0f is going to be deleted. [ 1107.508137] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.508345] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.515869] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.515980] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.519426] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.519533] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.567136] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.567405] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7dad645-1b67-495c-8fe3-ab50c7737c6c is going to be deleted. [ 1107.568458] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.568690] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.620922] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.621064] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.637762] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.637905] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0818539-e942-4d2b-a340-3442e08309ce is going to be deleted. [ 1107.638828] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.639075] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.639172] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.639291] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-458c7186-d79f-4548-a2a0-95db0abbb880" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.639450] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.639610] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.639682] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.639786] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38ffb088-7d22-4fae-a53e-e1d8ec1f1f3d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.640292] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.640449] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.640529] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.640644] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7dc294f2-c118-4967-a208-cb40fa247a04" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.640775] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.640940] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.641027] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.641139] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05c6d62a-58f1-418b-815e-8b3f7f5cd5eb" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.641265] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.641404] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.641478] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.641586] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6908af9-f839-40b2-9ca2-1fd554ee1d78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.641707] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.641925] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.641925] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.642017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0bc29505-f5b4-4554-85b9-541273bd8da3" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.642147] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.642283] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.642355] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.642464] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d66cc0b-bd33-47cb-9365-01d39638c887" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.642583] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.642716] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.642790] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.642891] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76ac020a-e732-4afe-ace5-7bd4b6ea9072" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.643067] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.643153] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.643229] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.643337] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8ff5e5b-5797-4254-b957-602d11e125dd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.643466] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.643600] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.643672] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.643780] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bceaf9d-1c44-4281-83d2-4109ac0771c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.643902] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.644249] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.644249] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.644249] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17f09989-f208-4cef-8aea-94e818aa9a91" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.644365] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.644468] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.644539] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.644648] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0210561b-43ff-434b-97ef-339a5d85a2a9" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.644765] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.644899] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.644975] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.645093] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77834f91-37e7-4feb-86e1-583e68d3d852" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.653580] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.653723] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.653782] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.653921] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.654033] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.654118] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-753050ac-8ed4-4825-8136-44279adacb0f" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.663440] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.663563] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.663619] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.664450] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.664450] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.664450] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7dad645-1b67-495c-8fe3-ab50c7737c6c" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.767630] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.767630] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.767800] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.767911] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.768009] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.768137] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0818539-e942-4d2b-a340-3442e08309ce" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.866210] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 96b2c90a-a7a0-4dcb-8212-5e459d8d4793: rpc.has_security_group_logging(os_id): False [ 1107.867402] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580: rpc.has_security_group_logging(os_id): False [ 1107.888295] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.888426] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.888498] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.888718] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.890251] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.890364] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.906537] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.907084] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.907084] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.907084] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.907217] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.907217] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.907343] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 is going to be updated. [ 1107.908229] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.908383] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.913843] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0461c6a-1d2b-401e-b59f-af6eda84b6ca: rpc.has_security_group_logging(os_id): False [ 1107.927259] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.927259] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.930026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.930026] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.930026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.930026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.930026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.930252] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.930252] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 is going to be updated. [ 1107.931141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.931307] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.950579] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.950772] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.950897] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.950966] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.951147] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.951226] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.951415] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.951514] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.951576] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.951717] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.951789] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.951995] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.952105] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.952169] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.952308] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.952381] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.952463] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca is going to be updated. [ 1107.964147] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.964267] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.964308] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.964467] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.964595] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.976872] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 in Status: IN_PROGRESS for 2s [ 1108.001632] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.001632] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.001768] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.001911] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.002118] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.013087] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 in Status: IN_PROGRESS for 2s [ 1108.023835] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.023989] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.024122] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.024342] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.024484] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.033478] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca in Status: IN_PROGRESS for 2s [ 1109.500515] env[69506]: INFO networking_nsxv3.common.synchronization [req-1eb7add8-8a81-4b48-9794-64cc2a9aa401 req-7e361fc8-0702-4afe-89c1-b90fec3d7877 tempest-MultipleCreateTestJSON-427740631 tempest-MultipleCreateTestJSON-427740631-project-member] Enqueued Resource ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 with Priority: HIGHEST for action security_group_members [ 1109.501066] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 with Priority: HIGHEST for action security_group_members [ 1109.501367] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-74f7fdee-99f0-4620-9ae9-86ee28797058 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.501487] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.501554] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.501810] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.502107] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.502107] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.502211] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.502322] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.502409] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.502498] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74f7fdee-99f0-4620-9ae9-86ee28797058',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.798055] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-821 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.798269] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-821" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.798404] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-821" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.798937] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-821" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.801999] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.802209] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.802335] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.802723] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.802723] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.802947] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1109.803167] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1109.803234] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1109.803387] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1109.803387] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1109.803495] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1109.803643] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1109.821278] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1109.821443] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1109.821588] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1109.821778] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-821" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.822170] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-a567cb44-4a40-4898-b07b-0709c19c37cc taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.822373] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-a567cb44-4a40-4898-b07b-0709c19c37cc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.823747] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-a567cb44-4a40-4898-b07b-0709c19c37cc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.824380] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-a567cb44-4a40-4898-b07b-0709c19c37cc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.824491] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a567cb44-4a40-4898-b07b-0709c19c37cc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.990057] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 in Status: SUCCESS [ 1109.990441] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.004994] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.005170] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.005244] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.005472] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.005563] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.005768] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.005869] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.005931] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.006113] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.006253] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.006340] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 already deleted. [ 1110.006426] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.021962] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 in Status: SUCCESS [ 1110.022173] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.044725] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca in Status: SUCCESS [ 1110.044933] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.045119] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.045326] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.045412] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0461c6a-1d2b-401e-b59f-af6eda84b6ca',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.328556] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.328556] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.328556] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.328556] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.328556] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.328556] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port a567cb44-4a40-4898-b07b-0709c19c37cc not found, creating... [ 1110.328556] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.329269] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.329269] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.329269] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.329269] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.329438] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.329593] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.329712] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.329918] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.330068] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.330213] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: a567cb44-4a40-4898-b07b-0709c19c37cc is going to be created. [ 1110.350027] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.350027] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.350027] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.350027] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.350027] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.350260] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-a567cb44-4a40-4898-b07b-0709c19c37cc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.366055] env[69506]: INFO networking_nsxv3.common.synchronization [req-21edda16-6c67-47ac-aae6-d22e08d33398 req-da9eefaa-dd6c-4e85-9e77-2d9ec4f28b3e tempest-ServersTestFqdnHostnames-1516588989 tempest-ServersTestFqdnHostnames-1516588989-project-member] Enqueued Resource ID: eee25a0e-a423-45cd-80e8-327029ae7dc4 with Priority: HIGHEST for action security_group_members [ 1110.366547] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eee25a0e-a423-45cd-80e8-327029ae7dc4 with Priority: HIGHEST for action security_group_members [ 1110.366876] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-eee25a0e-a423-45cd-80e8-327029ae7dc4 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.366999] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eee25a0e-a423-45cd-80e8-327029ae7dc4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.367077] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eee25a0e-a423-45cd-80e8-327029ae7dc4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.367269] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eee25a0e-a423-45cd-80e8-327029ae7dc4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.367419] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.367513] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.367575] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.367711] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.367793] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.367881] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eee25a0e-a423-45cd-80e8-327029ae7dc4',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.547469] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.547905] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.547905] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.547905] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.548126] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.548236] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.548309] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.548459] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.548544] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.548631] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.548828] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0461c6a-1d2b-401e-b59f-af6eda84b6ca',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.869851] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.870066] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.870145] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.870385] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.889981] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.890292] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.890411] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.890481] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.890684] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.890768] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.890856] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eee25a0e-a423-45cd-80e8-327029ae7dc4 is going to be updated. [ 1110.915742] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.916034] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.916034] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.916270] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.916465] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.932207] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eee25a0e-a423-45cd-80e8-327029ae7dc4 in Status: IN_PROGRESS for 2s [ 1111.054180] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.054334] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.054401] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.054681] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.054790] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.054886] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.054948] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.055117] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.055217] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.055303] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.055447] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.055553] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.055611] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.055775] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.055942] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.056050] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.056108] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.056258] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.056329] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.056480] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.056527] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0461c6a-1d2b-401e-b59f-af6eda84b6ca',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.087044] env[69506]: INFO networking_nsxv3.common.synchronization [req-1eb7add8-8a81-4b48-9794-64cc2a9aa401 req-f4a7a015-ca91-4164-940b-a7d46bac8fc2 service nova] Enqueued Resource ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 with Priority: HIGHEST for action security_group_rules [ 1111.087255] env[69506]: INFO networking_nsxv3.common.synchronization [req-1eb7add8-8a81-4b48-9794-64cc2a9aa401 req-f4a7a015-ca91-4164-940b-a7d46bac8fc2 service nova] Enqueued Resource ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 with Priority: HIGHEST for action security_group_members [ 1111.087405] env[69506]: INFO networking_nsxv3.common.synchronization [req-1eb7add8-8a81-4b48-9794-64cc2a9aa401 req-f4a7a015-ca91-4164-940b-a7d46bac8fc2 service nova] Enqueued Resource ID: a567cb44-4a40-4898-b07b-0709c19c37cc with Priority: HIGHEST for action port [ 1111.087899] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 with Priority: HIGHEST for action security_group_rules [ 1111.087991] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 with Priority: HIGHEST for action security_group_members [ 1111.091318] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a567cb44-4a40-4898-b07b-0709c19c37cc with Priority: HIGHEST for action port [ 1111.091958] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-74f7fdee-99f0-4620-9ae9-86ee28797058 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.091958] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.091958] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.092147] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.092187] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('74f7fdee-99f0-4620-9ae9-86ee28797058',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.093333] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-74f7fdee-99f0-4620-9ae9-86ee28797058 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.093454] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.093522] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.093706] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.093859] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.093957] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.094032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.095162] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.095162] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.095162] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74f7fdee-99f0-4620-9ae9-86ee28797058',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.095473] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-a567cb44-4a40-4898-b07b-0709c19c37cc taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.095850] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a567cb44-4a40-4898-b07b-0709c19c37cc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.095927] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a567cb44-4a40-4898-b07b-0709c19c37cc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.096096] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a567cb44-4a40-4898-b07b-0709c19c37cc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.096172] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a567cb44-4a40-4898-b07b-0709c19c37cc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.558931] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0461c6a-1d2b-401e-b59f-af6eda84b6ca: rpc.has_security_group_logging(os_id): False [ 1111.577735] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.577882] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.577956] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.578189] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.578281] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.578497] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.578598] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.578662] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.578821] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.578922] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.579614] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.579614] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.579614] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.579614] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.579614] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.579852] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.579852] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.579929] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.580205] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.580420] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.580597] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca is going to be updated. [ 1111.598699] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-74f7fdee-99f0-4620-9ae9-86ee28797058 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.598699] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.598974] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('74f7fdee-99f0-4620-9ae9-86ee28797058',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.600227] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a567cb44-4a40-4898-b07b-0709c19c37cc with status ACTIVE [ 1111.600227] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.600399] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.600399] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.600659] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.600786] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.601027] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.601130] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.601192] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.601365] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.601448] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.601640] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.601740] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.601798] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.601954] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.602052] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.602156] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a567cb44-4a40-4898-b07b-0709c19c37cc is going to be updated. [ 1111.619876] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.620029] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.620301] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.620301] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.620414] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.620602] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a567cb44-4a40-4898-b07b-0709c19c37cc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.640547] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.640547] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.640547] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.640726] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.640888] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.654817] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca in Status: IN_PROGRESS for 2s [ 1111.895203] env[69506]: INFO networking_nsxv3.common.synchronization [req-1eb7add8-8a81-4b48-9794-64cc2a9aa401 req-136221d5-1dcb-494f-9fb6-13afd0390056 tempest-MultipleCreateTestJSON-427740631 tempest-MultipleCreateTestJSON-427740631-project-member] Enqueued Resource ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 with Priority: HIGHEST for action security_group_members [ 1111.895705] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 with Priority: HIGHEST for action security_group_members [ 1111.896014] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-74f7fdee-99f0-4620-9ae9-86ee28797058 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.896115] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.104963] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('74f7fdee-99f0-4620-9ae9-86ee28797058',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.171563] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-821 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.171771] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-821" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.171907] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-821" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.172267] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-821" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.172535] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.172704] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.172829] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.173078] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.173214] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.173430] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1112.173548] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1112.173661] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1112.173774] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1112.173897] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1112.174028] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1112.174198] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1112.196456] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1112.196705] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1112.196784] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1112.197051] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-821" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.197472] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-4f0f07f8-29ce-4e55-a873-9efbbc0ced8b taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.197724] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-4f0f07f8-29ce-4e55-a873-9efbbc0ced8b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.197901] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-4f0f07f8-29ce-4e55-a873-9efbbc0ced8b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.198355] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-4f0f07f8-29ce-4e55-a873-9efbbc0ced8b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.198566] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f0f07f8-29ce-4e55-a873-9efbbc0ced8b',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.470156] env[69506]: INFO networking_nsxv3.common.synchronization [req-378fa8b9-f59b-497a-98ae-d8f140f8ec74 req-7cb9f451-5659-41f9-accb-6beba3f68d5f tempest-ServersNegativeTestJSON-1250642852 tempest-ServersNegativeTestJSON-1250642852-project-member] Enqueued Resource ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca with Priority: HIGHEST for action security_group_members [ 1112.470729] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca with Priority: HIGHEST for action security_group_members [ 1112.471342] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.472023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.472023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.472023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.472023] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.472321] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.472397] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.472559] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.472648] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.472744] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0461c6a-1d2b-401e-b59f-af6eda84b6ca',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.611060] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.611407] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.611407] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.611482] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.611592] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.611718] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 is going to be created. [ 1112.633108] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.633253] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.633326] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.633483] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.633633] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.641485] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 in Status: UNINITIALIZED for 2s [ 1112.701139] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.701381] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.701513] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.701789] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.701986] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.702163] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 4f0f07f8-29ce-4e55-a873-9efbbc0ced8b not found, creating... [ 1112.702423] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.702581] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.702700] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.702937] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.703114] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.703403] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.703561] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.703683] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.703897] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.704049] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.704671] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 4f0f07f8-29ce-4e55-a873-9efbbc0ced8b is going to be created. [ 1112.724251] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.724513] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.724675] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.725065] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.725320] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.725514] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-4f0f07f8-29ce-4e55-a873-9efbbc0ced8b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.942028] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eee25a0e-a423-45cd-80e8-327029ae7dc4 in Status: SUCCESS [ 1112.942251] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eee25a0e-a423-45cd-80e8-327029ae7dc4 deletion is rescheduled due to dependency. [ 1112.942375] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eee25a0e-a423-45cd-80e8-327029ae7dc4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.977955] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0461c6a-1d2b-401e-b59f-af6eda84b6ca',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.416487] env[69506]: INFO networking_nsxv3.common.synchronization [req-1eb7add8-8a81-4b48-9794-64cc2a9aa401 req-af0521d7-bb28-41bf-baaa-72aebf46a05e service nova] Enqueued Resource ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 with Priority: HIGHEST for action security_group_rules [ 1113.416982] env[69506]: INFO networking_nsxv3.common.synchronization [req-1eb7add8-8a81-4b48-9794-64cc2a9aa401 req-af0521d7-bb28-41bf-baaa-72aebf46a05e service nova] Enqueued Resource ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 with Priority: HIGHEST for action security_group_members [ 1113.416982] env[69506]: INFO networking_nsxv3.common.synchronization [req-1eb7add8-8a81-4b48-9794-64cc2a9aa401 req-af0521d7-bb28-41bf-baaa-72aebf46a05e service nova] Enqueued Resource ID: 4f0f07f8-29ce-4e55-a873-9efbbc0ced8b with Priority: HIGHEST for action port [ 1113.417062] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 with Priority: HIGHEST for action security_group_rules [ 1113.417182] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 with Priority: HIGHEST for action security_group_members [ 1113.417269] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f0f07f8-29ce-4e55-a873-9efbbc0ced8b with Priority: HIGHEST for action port [ 1113.417891] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-74f7fdee-99f0-4620-9ae9-86ee28797058 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.418011] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.419809] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-74f7fdee-99f0-4620-9ae9-86ee28797058 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.419950] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.420106] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f0f07f8-29ce-4e55-a873-9efbbc0ced8b taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.420210] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f0f07f8-29ce-4e55-a873-9efbbc0ced8b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.420268] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f0f07f8-29ce-4e55-a873-9efbbc0ced8b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.420470] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f0f07f8-29ce-4e55-a873-9efbbc0ced8b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.420540] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f0f07f8-29ce-4e55-a873-9efbbc0ced8b',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.480581] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0461c6a-1d2b-401e-b59f-af6eda84b6ca',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.667736] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca in Status: SUCCESS [ 1113.668072] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.924720] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4f0f07f8-29ce-4e55-a873-9efbbc0ced8b with status ACTIVE [ 1113.924967] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.925134] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.925201] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.925421] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.925512] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.925691] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.925799] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.925861] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.926024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.926075] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.926239] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.926400] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.926400] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.926509] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.926965] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.926965] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4f0f07f8-29ce-4e55-a873-9efbbc0ced8b is going to be updated. [ 1113.946090] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.946287] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.946287] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.946479] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.946645] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.946758] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f0f07f8-29ce-4e55-a873-9efbbc0ced8b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.982459] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.982621] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.982699] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.982895] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.982986] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.983097] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca is going to be updated. [ 1114.012889] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.012889] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.012889] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.012889] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.012889] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.019504] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca in Status: IN_PROGRESS for 2s [ 1114.300291] env[69506]: INFO networking_nsxv3.common.synchronization [req-e0af5104-c4f8-4207-a972-2824162a76d0 req-c420248d-5c91-4a93-961f-87a437807cb7 tempest-AttachVolumeNegativeTest-402732870 tempest-AttachVolumeNegativeTest-402732870-project-member] Enqueued Resource ID: c29a3314-8167-42dc-9e04-3dc4cb967960 with Priority: HIGHEST for action security_group_members [ 1114.300830] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c29a3314-8167-42dc-9e04-3dc4cb967960 with Priority: HIGHEST for action security_group_members [ 1114.301175] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-c29a3314-8167-42dc-9e04-3dc4cb967960 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.301299] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c29a3314-8167-42dc-9e04-3dc4cb967960" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.301368] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c29a3314-8167-42dc-9e04-3dc4cb967960" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.301623] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c29a3314-8167-42dc-9e04-3dc4cb967960" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.301778] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.301880] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.301944] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.303758] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.303859] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.304990] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c29a3314-8167-42dc-9e04-3dc4cb967960',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.601758] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-477 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.601991] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-477" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.602165] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-477" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.602437] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-477" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.602692] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.602850] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.603013] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.603449] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.603617] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.603904] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1114.604058] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1114.604180] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1114.604291] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1114.604408] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1114.604530] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1114.604723] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1114.621830] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1114.621996] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1114.622183] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1114.622362] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-477" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.622655] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-f8cf1fb3-b03e-4935-b108-0accaf9a52f4 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.622871] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-f8cf1fb3-b03e-4935-b108-0accaf9a52f4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.623008] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-f8cf1fb3-b03e-4935-b108-0accaf9a52f4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.623318] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-f8cf1fb3-b03e-4935-b108-0accaf9a52f4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.623463] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8cf1fb3-b03e-4935-b108-0accaf9a52f4',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.650436] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 in Status: SUCCESS [ 1114.650656] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.650788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.651048] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.651241] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.651352] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.651419] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.651570] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.651669] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.651727] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.651821] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('74f7fdee-99f0-4620-9ae9-86ee28797058',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.652951] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.653177] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.653336] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.653435] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.653499] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.653635] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.653753] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.653793] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74f7fdee-99f0-4620-9ae9-86ee28797058',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.807167] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.807615] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.807615] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.807706] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.807848] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.808150] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.808289] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.808408] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.808997] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.809101] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.809226] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c29a3314-8167-42dc-9e04-3dc4cb967960 already deleted. [ 1114.809331] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c29a3314-8167-42dc-9e04-3dc4cb967960" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.126012] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.126269] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.126441] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.126724] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.126908] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.127086] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port f8cf1fb3-b03e-4935-b108-0accaf9a52f4 not found, creating... [ 1115.127367] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.127547] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.127658] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.127872] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.128080] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.128409] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.129185] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.129527] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.129776] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.129926] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.130115] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: f8cf1fb3-b03e-4935-b108-0accaf9a52f4 is going to be created. [ 1115.150361] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.152041] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.152041] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.152041] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.152041] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.152041] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-f8cf1fb3-b03e-4935-b108-0accaf9a52f4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.157706] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-74f7fdee-99f0-4620-9ae9-86ee28797058 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.157706] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.157874] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('74f7fdee-99f0-4620-9ae9-86ee28797058',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.659958] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('74f7fdee-99f0-4620-9ae9-86ee28797058',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.031794] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca in Status: SUCCESS [ 1116.032661] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.162270] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.162473] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.162506] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.162714] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.162806] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.162921] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 is going to be updated. [ 1116.192123] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.192123] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.192123] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.192123] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.192123] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.200455] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 in Status: IN_PROGRESS for 2s [ 1116.410965] env[69506]: INFO networking_nsxv3.common.synchronization [req-e0af5104-c4f8-4207-a972-2824162a76d0 req-eb238e6a-dce5-4ba9-a540-39fc43006a17 service nova] Enqueued Resource ID: c29a3314-8167-42dc-9e04-3dc4cb967960 with Priority: HIGHEST for action security_group_rules [ 1116.411235] env[69506]: INFO networking_nsxv3.common.synchronization [req-e0af5104-c4f8-4207-a972-2824162a76d0 req-eb238e6a-dce5-4ba9-a540-39fc43006a17 service nova] Enqueued Resource ID: c29a3314-8167-42dc-9e04-3dc4cb967960 with Priority: HIGHEST for action security_group_members [ 1116.411386] env[69506]: INFO networking_nsxv3.common.synchronization [req-e0af5104-c4f8-4207-a972-2824162a76d0 req-eb238e6a-dce5-4ba9-a540-39fc43006a17 service nova] Enqueued Resource ID: f8cf1fb3-b03e-4935-b108-0accaf9a52f4 with Priority: HIGHEST for action port [ 1116.411910] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c29a3314-8167-42dc-9e04-3dc4cb967960 with Priority: HIGHEST for action security_group_rules [ 1116.412559] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c29a3314-8167-42dc-9e04-3dc4cb967960 with Priority: HIGHEST for action security_group_members [ 1116.412750] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8cf1fb3-b03e-4935-b108-0accaf9a52f4 with Priority: HIGHEST for action port [ 1116.413026] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c29a3314-8167-42dc-9e04-3dc4cb967960 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.413156] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c29a3314-8167-42dc-9e04-3dc4cb967960" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.413226] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c29a3314-8167-42dc-9e04-3dc4cb967960" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.413462] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c29a3314-8167-42dc-9e04-3dc4cb967960" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.413559] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c29a3314-8167-42dc-9e04-3dc4cb967960',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.414427] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-c29a3314-8167-42dc-9e04-3dc4cb967960 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.414543] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c29a3314-8167-42dc-9e04-3dc4cb967960" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.414640] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c29a3314-8167-42dc-9e04-3dc4cb967960" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.414875] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c29a3314-8167-42dc-9e04-3dc4cb967960" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.415093] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.415208] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.415348] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.415434] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.415518] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.415609] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c29a3314-8167-42dc-9e04-3dc4cb967960',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.416832] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8cf1fb3-b03e-4935-b108-0accaf9a52f4 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.416948] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8cf1fb3-b03e-4935-b108-0accaf9a52f4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.417015] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8cf1fb3-b03e-4935-b108-0accaf9a52f4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.417174] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8cf1fb3-b03e-4935-b108-0accaf9a52f4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.417795] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8cf1fb3-b03e-4935-b108-0accaf9a52f4',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.919282] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-c29a3314-8167-42dc-9e04-3dc4cb967960 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.919407] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c29a3314-8167-42dc-9e04-3dc4cb967960" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.919795] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c29a3314-8167-42dc-9e04-3dc4cb967960',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.923318] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f8cf1fb3-b03e-4935-b108-0accaf9a52f4 with status ACTIVE [ 1116.923318] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.923490] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.923590] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.923841] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.923937] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.924128] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.924231] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.924309] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.924497] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.924615] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.924845] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.924987] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.925073] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.925220] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.925292] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.925393] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f8cf1fb3-b03e-4935-b108-0accaf9a52f4 is going to be updated. [ 1116.945965] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.946124] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.946221] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.946527] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.946667] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.946820] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8cf1fb3-b03e-4935-b108-0accaf9a52f4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.424229] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c29a3314-8167-42dc-9e04-3dc4cb967960',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.927592] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.927770] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.927813] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.928062] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.928170] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.928276] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c29a3314-8167-42dc-9e04-3dc4cb967960 is going to be created. [ 1117.957811] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.957990] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.957990] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.958366] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.958448] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.969692] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c29a3314-8167-42dc-9e04-3dc4cb967960 in Status: UNINITIALIZED for 2s [ 1118.213174] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 in Status: SUCCESS [ 1118.213439] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.213616] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.213827] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.214024] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.214139] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.214205] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.214355] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.214433] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.214529] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74f7fdee-99f0-4620-9ae9-86ee28797058',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.717071] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('74f7fdee-99f0-4620-9ae9-86ee28797058',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.219263] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('74f7fdee-99f0-4620-9ae9-86ee28797058',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.721794] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.721794] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.721794] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.722388] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.722388] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.722388] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 is going to be updated. [ 1119.748352] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.748447] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.748534] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.748746] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.748903] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.758633] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 in Status: IN_PROGRESS for 2s [ 1119.978915] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c29a3314-8167-42dc-9e04-3dc4cb967960 in Status: SUCCESS [ 1119.979266] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c29a3314-8167-42dc-9e04-3dc4cb967960" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.979481] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c29a3314-8167-42dc-9e04-3dc4cb967960" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.979704] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c29a3314-8167-42dc-9e04-3dc4cb967960" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.979874] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.979936] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.980108] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.980223] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.980303] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.980388] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c29a3314-8167-42dc-9e04-3dc4cb967960" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.980652] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c29a3314-8167-42dc-9e04-3dc4cb967960',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.004895] env[69506]: INFO networking_nsxv3.common.synchronization [req-efab2dba-9c6c-484b-8420-7f975a36fd7a req-d1d3e5f5-b04a-4e95-a9fc-e8025a6401a6 tempest-ServersTestJSON-1801092994 tempest-ServersTestJSON-1801092994-project-member] Enqueued Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 1120.005554] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 1120.006062] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.006062] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.006189] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.006351] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.006527] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.006634] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.006696] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.006855] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.006953] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.007073] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.483465] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c29a3314-8167-42dc-9e04-3dc4cb967960',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.509919] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.986212] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c29a3314-8167-42dc-9e04-3dc4cb967960: rpc.has_security_group_logging(os_id): False [ 1121.002884] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.003312] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.003434] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.003719] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.004067] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.004252] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.004413] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.004516] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.004720] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.004804] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.004898] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c29a3314-8167-42dc-9e04-3dc4cb967960 is going to be created. [ 1121.011496] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.059942] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.060117] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.060191] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.060400] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.060574] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.069613] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c29a3314-8167-42dc-9e04-3dc4cb967960 in Status: IN_PROGRESS for 2s [ 1121.513868] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.514020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.514088] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.514942] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.514942] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.514942] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc is going to be updated. [ 1121.555435] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.555616] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.555616] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.555748] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.555886] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.563987] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: IN_PROGRESS for 2s [ 1121.767889] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 in Status: SUCCESS [ 1121.768064] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.768205] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.768431] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.768628] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.768753] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.768815] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.768973] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.769076] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.769168] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.769357] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-74f7fdee-99f0-4620-9ae9-86ee28797058 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.769471] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.769541] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.769677] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.769816] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.769907] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.769968] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.770355] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.770448] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.770575] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.770681] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('74f7fdee-99f0-4620-9ae9-86ee28797058',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.272915] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 74f7fdee-99f0-4620-9ae9-86ee28797058: rpc.has_security_group_logging(os_id): False [ 1122.290823] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.290962] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.291049] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.291313] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.291415] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.291649] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.291747] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.291813] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.291962] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.292049] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.292265] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.292414] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.292497] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.292903] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.292903] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.292903] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.293055] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.293055] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.293182] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.293252] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.293314] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 is going to be created. [ 1122.345229] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.345425] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.345425] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.345618] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.345798] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.356770] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 in Status: IN_PROGRESS for 2s [ 1123.081753] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c29a3314-8167-42dc-9e04-3dc4cb967960 in Status: SUCCESS [ 1123.081753] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c29a3314-8167-42dc-9e04-3dc4cb967960" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.573407] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: SUCCESS [ 1123.573407] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.899617] env[69506]: INFO networking_nsxv3.common.synchronization [req-1b3785d2-4917-404e-813c-8e27e3d2de1c req-afeda14d-9d86-45c3-96f4-b43c8e358c00 tempest-MultipleCreateTestJSON-427740631 tempest-MultipleCreateTestJSON-427740631-project-member] Enqueued Resource ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 with Priority: HIGHEST for action security_group_members [ 1123.902026] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 with Priority: HIGHEST for action security_group_members [ 1123.902026] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-74f7fdee-99f0-4620-9ae9-86ee28797058 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.902026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.902026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.902026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.902026] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.902026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.902026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.902582] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.902814] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.902996] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74f7fdee-99f0-4620-9ae9-86ee28797058',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.959936] env[69506]: INFO networking_nsxv3.common.synchronization [req-186cab74-5539-4d21-a15b-9d47769822af req-f6c9abc7-1f07-4526-8ea0-821957747819 tempest-MultipleCreateTestJSON-427740631 tempest-MultipleCreateTestJSON-427740631-project-member] Enqueued Resource ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 with Priority: HIGHEST for action security_group_members [ 1123.960226] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 with Priority: HIGHEST for action security_group_members [ 1123.960478] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-74f7fdee-99f0-4620-9ae9-86ee28797058 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.960570] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.370098] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 in Status: SUCCESS [ 1124.370319] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.370521] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.370764] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.370855] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('74f7fdee-99f0-4620-9ae9-86ee28797058',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.404651] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('74f7fdee-99f0-4620-9ae9-86ee28797058',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.890591] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.890591] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.890591] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.890591] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.890982] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.890982] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 is going to be deleted. [ 1124.906299] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('74f7fdee-99f0-4620-9ae9-86ee28797058',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.936269] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.936537] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.936537] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.936703] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.936794] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.936920] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.408888] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.409046] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.409137] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.409390] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.409486] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.409586] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 is going to be updated. [ 1125.435400] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.435547] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.435631] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.435849] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.436030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.444709] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 in Status: IN_PROGRESS for 2s [ 1126.770469] env[69506]: INFO networking_nsxv3.common.synchronization [req-261f1d78-df4a-4ec0-bdde-2a00438b6002 req-057a3059-dc11-42a3-acf5-e6639f5e4c78 tempest-DeleteServersTestJSON-1880805458 tempest-DeleteServersTestJSON-1880805458-project-member] Enqueued Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_members [ 1126.770988] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_members [ 1126.771742] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.771742] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.771742] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.771742] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.771936] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.771936] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.772010] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.772308] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.772438] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.772557] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.233020] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-628 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.233020] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-628" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.233020] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-628" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.233020] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-628" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.233020] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.233020] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.233020] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.233020] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.233020] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.233475] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1127.233475] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1127.233814] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1127.234031] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1127.234175] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1127.234294] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1127.236134] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1127.255280] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1127.255452] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1127.255594] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1127.255772] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-628" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.256096] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-8dca9854-2be0-4e7f-9bd0-8f0fb5a19e68 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.256277] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-8dca9854-2be0-4e7f-9bd0-8f0fb5a19e68" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.256402] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-8dca9854-2be0-4e7f-9bd0-8f0fb5a19e68" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.256736] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-8dca9854-2be0-4e7f-9bd0-8f0fb5a19e68" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.256888] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dca9854-2be0-4e7f-9bd0-8f0fb5a19e68',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.276623] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.276855] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.276855] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.277025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.313562] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.313562] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.313562] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.313562] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.313562] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.313562] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.313562] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d is going to be updated. [ 1127.349837] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.350020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.350096] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.350308] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.350448] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.363242] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: IN_PROGRESS for 2s [ 1127.456567] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 in Status: SUCCESS [ 1127.456786] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.456950] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.457193] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.457420] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.457541] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.457605] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.457766] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.457885] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.457935] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74f7fdee-99f0-4620-9ae9-86ee28797058',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.760010] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.760010] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.760010] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.760168] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.760255] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.761588] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 8dca9854-2be0-4e7f-9bd0-8f0fb5a19e68 not found, creating... [ 1127.761588] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.761588] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.761588] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.761588] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.761588] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.761986] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.761986] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.762141] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.762288] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.762441] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.762586] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 8dca9854-2be0-4e7f-9bd0-8f0fb5a19e68 is going to be created. [ 1127.781612] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.781962] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.781962] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.782247] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.782505] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.782744] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-8dca9854-2be0-4e7f-9bd0-8f0fb5a19e68" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.962488] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.962707] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.962767] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.962946] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.963048] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.963250] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.963379] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.963442] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.963662] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.963662] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.963757] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 is going to be deleted. [ 1127.997853] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.998043] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.998043] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.998708] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.998708] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.998708] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.456121] env[69506]: INFO networking_nsxv3.common.synchronization [req-261f1d78-df4a-4ec0-bdde-2a00438b6002 req-d81ff0d6-bac8-49a7-a653-4d518ebb9950 service nova] Enqueued Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_rules [ 1128.456310] env[69506]: INFO networking_nsxv3.common.synchronization [req-261f1d78-df4a-4ec0-bdde-2a00438b6002 req-d81ff0d6-bac8-49a7-a653-4d518ebb9950 service nova] Enqueued Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_members [ 1128.457166] env[69506]: INFO networking_nsxv3.common.synchronization [req-261f1d78-df4a-4ec0-bdde-2a00438b6002 req-d81ff0d6-bac8-49a7-a653-4d518ebb9950 service nova] Enqueued Resource ID: 8dca9854-2be0-4e7f-9bd0-8f0fb5a19e68 with Priority: HIGHEST for action port [ 1128.457166] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_rules [ 1128.457166] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_members [ 1128.457166] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8dca9854-2be0-4e7f-9bd0-8f0fb5a19e68 with Priority: HIGHEST for action port [ 1128.457497] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.457613] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.457679] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.457877] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.457956] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.458846] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.458955] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.459806] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-8dca9854-2be0-4e7f-9bd0-8f0fb5a19e68 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.459806] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8dca9854-2be0-4e7f-9bd0-8f0fb5a19e68" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.459806] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8dca9854-2be0-4e7f-9bd0-8f0fb5a19e68" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.459806] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8dca9854-2be0-4e7f-9bd0-8f0fb5a19e68" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.459806] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dca9854-2be0-4e7f-9bd0-8f0fb5a19e68',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.961868] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.962381] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.962381] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8dca9854-2be0-4e7f-9bd0-8f0fb5a19e68 with status ACTIVE [ 1128.962381] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.962673] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.962673] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.962782] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.962834] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.962990] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.963098] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.963155] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.963309] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.963390] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.963580] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.963692] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.963769] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.963938] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.963938] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.964074] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8dca9854-2be0-4e7f-9bd0-8f0fb5a19e68 is going to be updated. [ 1128.985796] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.985943] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.986021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.986221] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.986456] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.986528] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8dca9854-2be0-4e7f-9bd0-8f0fb5a19e68" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.145654] env[69506]: INFO networking_nsxv3.common.synchronization [req-4323745b-1b1b-4f14-b049-4f718c97a1bd req-20ed92c3-ede9-48f8-abb7-891eee20506a tempest-ServerActionsTestJSON-78405165 tempest-ServerActionsTestJSON-78405165-project-member] Enqueued Resource ID: c141011f-1c58-45cb-b73c-ad882255b77a with Priority: HIGHEST for action security_group_members [ 1129.147098] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c141011f-1c58-45cb-b73c-ad882255b77a with Priority: HIGHEST for action security_group_members [ 1129.147098] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-c141011f-1c58-45cb-b73c-ad882255b77a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.147098] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c141011f-1c58-45cb-b73c-ad882255b77a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.147098] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c141011f-1c58-45cb-b73c-ad882255b77a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.147098] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c141011f-1c58-45cb-b73c-ad882255b77a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.147098] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.147472] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.147472] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.147472] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.147472] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.147577] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c141011f-1c58-45cb-b73c-ad882255b77a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.372180] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: SUCCESS [ 1129.372363] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d deletion is rescheduled due to dependency. [ 1129.372481] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.372657] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.373113] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.373113] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.373289] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.373289] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.373397] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.373585] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.373585] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.649917] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.650142] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.650237] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.650540] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.668916] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.669210] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.669329] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.669396] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.669584] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.669667] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.669756] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c141011f-1c58-45cb-b73c-ad882255b77a is going to be updated. [ 1129.691569] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.691748] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.691801] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.691967] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.692115] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.699012] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c141011f-1c58-45cb-b73c-ad882255b77a in Status: IN_PROGRESS for 2s [ 1129.877041] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.379587] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.881125] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.881328] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.881380] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.881589] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.881679] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.881781] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d is going to be updated. [ 1130.933263] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.933497] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.933497] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.933705] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.933850] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.943524] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: IN_PROGRESS for 2s [ 1131.707958] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c141011f-1c58-45cb-b73c-ad882255b77a in Status: SUCCESS [ 1131.708256] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c141011f-1c58-45cb-b73c-ad882255b77a deletion is rescheduled due to dependency. [ 1131.708256] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c141011f-1c58-45cb-b73c-ad882255b77a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.953211] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: SUCCESS [ 1132.953631] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.953631] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.953825] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.953970] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.954101] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.954169] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.954315] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.954392] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.954471] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.954562] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.457218] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.457411] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.457491] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.457708] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.457878] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.457980] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.458059] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.458326] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.458326] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.458431] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.458523] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.458680] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.458680] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.460072] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.460072] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.460072] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.460072] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.460072] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.460072] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.460072] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.460072] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.962017] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d: rpc.has_security_group_logging(os_id): False [ 1133.979329] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.979529] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.979605] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.979823] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.979913] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.980197] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.980276] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.980325] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.980493] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.980577] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.980765] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.980858] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.980988] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.981086] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.981141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.981370] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.981470] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.981521] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.981709] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.981775] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.982025] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d is going to be updated. [ 1134.043518] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.043716] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.043765] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.043948] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.044103] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.057489] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: IN_PROGRESS for 2s [ 1134.147139] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1134.147293] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1136.071516] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: SUCCESS [ 1136.071847] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.148217] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1139.148797] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1139.974724] env[69506]: INFO networking_nsxv3.common.synchronization [req-fa2e5d00-32b5-4f28-9136-e26cbbeb5c29 req-7e308619-49dd-480c-b3c4-a2911ba8a383 tempest-ServersTestJSON-1801092994 tempest-ServersTestJSON-1801092994-project-member] Enqueued Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 1139.975344] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 1139.975715] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.975968] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.976080] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.976281] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.976492] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.976649] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.976764] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.976973] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.977117] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.977266] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.283258] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-54 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.283600] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-54" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.283839] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-54" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.284285] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-54" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.284709] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.284984] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.285283] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.285632] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.285892] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.286266] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1140.286491] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1140.286715] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1140.286925] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1140.287107] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1140.287237] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1140.287381] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1140.309615] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1140.309803] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1140.309932] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1140.310210] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-54" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.310523] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-3431a4c0-ffbf-4ff8-ae0e-575eee4c7b60 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.310771] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-3431a4c0-ffbf-4ff8-ae0e-575eee4c7b60" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.310918] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-3431a4c0-ffbf-4ff8-ae0e-575eee4c7b60" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.311163] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-3431a4c0-ffbf-4ff8-ae0e-575eee4c7b60" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.311309] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3431a4c0-ffbf-4ff8-ae0e-575eee4c7b60',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.483184] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.813389] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.813659] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.813799] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.814151] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.814317] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.814497] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 3431a4c0-ffbf-4ff8-ae0e-575eee4c7b60 not found, creating... [ 1140.814808] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.814975] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.815328] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.815458] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.815695] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.816612] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.816806] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.816936] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.817218] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.817387] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.817552] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 3431a4c0-ffbf-4ff8-ae0e-575eee4c7b60 is going to be created. [ 1140.836107] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.836328] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.836471] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.836806] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.837043] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.837298] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-3431a4c0-ffbf-4ff8-ae0e-575eee4c7b60" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.986207] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.488586] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.489018] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.489018] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.489318] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.489435] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.489587] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc is going to be updated. [ 1141.519264] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.519264] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.519264] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.519661] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.519863] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.529359] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: IN_PROGRESS for 2s [ 1141.811213] env[69506]: INFO networking_nsxv3.common.synchronization [req-fa2e5d00-32b5-4f28-9136-e26cbbeb5c29 req-26cc5ba1-00b5-4d3d-94a9-7f1c06c565a4 service nova] Enqueued Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_rules [ 1141.811453] env[69506]: INFO networking_nsxv3.common.synchronization [req-fa2e5d00-32b5-4f28-9136-e26cbbeb5c29 req-26cc5ba1-00b5-4d3d-94a9-7f1c06c565a4 service nova] Enqueued Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 1141.811670] env[69506]: INFO networking_nsxv3.common.synchronization [req-fa2e5d00-32b5-4f28-9136-e26cbbeb5c29 req-26cc5ba1-00b5-4d3d-94a9-7f1c06c565a4 service nova] Enqueued Resource ID: 3431a4c0-ffbf-4ff8-ae0e-575eee4c7b60 with Priority: HIGHEST for action port [ 1141.814443] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_rules [ 1141.814443] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 1141.814443] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3431a4c0-ffbf-4ff8-ae0e-575eee4c7b60 with Priority: HIGHEST for action port [ 1141.814443] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.814443] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.814443] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.814443] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.814443] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.814443] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.815021] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.815021] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-3431a4c0-ffbf-4ff8-ae0e-575eee4c7b60 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.816874] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3431a4c0-ffbf-4ff8-ae0e-575eee4c7b60" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.816990] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3431a4c0-ffbf-4ff8-ae0e-575eee4c7b60" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.817299] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3431a4c0-ffbf-4ff8-ae0e-575eee4c7b60" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.817299] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3431a4c0-ffbf-4ff8-ae0e-575eee4c7b60',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.319139] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.319352] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.319488] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3431a4c0-ffbf-4ff8-ae0e-575eee4c7b60 with status ACTIVE [ 1142.319665] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.319775] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.319844] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.320074] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.320158] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.320333] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.320431] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.320493] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.320652] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.320720] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.320899] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.320990] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.321055] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.321200] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.321277] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.321362] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3431a4c0-ffbf-4ff8-ae0e-575eee4c7b60 is going to be updated. [ 1142.345980] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.346154] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.346232] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.346426] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.346554] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.346871] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3431a4c0-ffbf-4ff8-ae0e-575eee4c7b60" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.538674] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: SUCCESS [ 1143.539070] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.539070] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.539249] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.539466] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.539578] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.539642] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.539791] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.539874] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.539970] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.042869] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.109805] env[69506]: INFO networking_nsxv3.common.synchronization [req-b1cfb184-c9ba-4140-b100-73f6aa287f6e req-b9900f61-0026-45ac-a7fa-2c6103d3d126 tempest-MultipleCreateTestJSON-427740631 tempest-MultipleCreateTestJSON-427740631-project-member] Enqueued Resource ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 with Priority: HIGHEST for action security_group_members [ 1144.110351] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 with Priority: HIGHEST for action security_group_members [ 1144.114524] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-74f7fdee-99f0-4620-9ae9-86ee28797058 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.114524] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.114524] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.114524] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.114524] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.114524] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.114524] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.114524] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.114524] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.114524] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74f7fdee-99f0-4620-9ae9-86ee28797058',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.333504] env[69506]: INFO networking_nsxv3.common.synchronization [req-2908a7c5-4ec1-400d-a362-fe0bb2d3ea9f req-b3850d68-baba-40d7-a344-3f9332665aa2 tempest-ServerActionsTestOtherB-347258904 tempest-ServerActionsTestOtherB-347258904-project-member] Enqueued Resource ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 with Priority: HIGHEST for action security_group_members [ 1144.334761] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 with Priority: HIGHEST for action security_group_members [ 1144.336062] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.336197] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.336271] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.336484] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.336654] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.336756] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.336820] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.336988] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.337087] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.337184] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fca9cd47-c1fb-4023-8f12-fa1b22a98fd8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.547039] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.614894] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.615142] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.615142] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.615335] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.615423] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.618243] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.618243] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.618243] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.618243] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.618243] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.618243] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 already deleted. [ 1144.618243] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.656330] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-821 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.656549] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-821" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.656760] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-821" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.657169] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-821" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.657557] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.657758] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.657909] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.658225] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.658394] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.658676] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1144.658856] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1144.658987] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1144.659120] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1144.659457] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1144.659542] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1144.659802] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1144.677586] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1144.677770] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1144.677908] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1144.678295] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-821" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.678437] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-d72f1939-13ab-439e-906a-8f70660883c7 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.678617] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-d72f1939-13ab-439e-906a-8f70660883c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.678743] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-d72f1939-13ab-439e-906a-8f70660883c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.679093] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-d72f1939-13ab-439e-906a-8f70660883c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.679243] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d72f1939-13ab-439e-906a-8f70660883c7',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.839946] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.840184] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.840184] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.840668] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.860515] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.860867] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.861067] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.861178] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.861409] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.861569] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.861671] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 is going to be updated. [ 1144.884234] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.884514] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.884514] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.884683] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.884783] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.892152] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 in Status: IN_PROGRESS for 2s [ 1145.050018] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.050195] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.050273] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.050563] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.050636] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.050739] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc is going to be updated. [ 1145.079850] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.079850] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.079850] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.079850] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.079850] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.086370] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: IN_PROGRESS for 2s [ 1145.181571] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.181826] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.181957] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.182254] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.182407] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.182592] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port d72f1939-13ab-439e-906a-8f70660883c7 not found, creating... [ 1145.182927] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.183040] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.183162] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.183385] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.183526] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.183823] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.183977] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.184118] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.184330] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.184468] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.184617] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: d72f1939-13ab-439e-906a-8f70660883c7 is going to be created. [ 1145.209230] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.209559] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.209701] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.209982] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.210227] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.210462] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-d72f1939-13ab-439e-906a-8f70660883c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.906426] env[69506]: INFO networking_nsxv3.common.synchronization [req-b1cfb184-c9ba-4140-b100-73f6aa287f6e req-24cee4d5-6c07-4e1a-b799-24f10b804c0b service nova] Enqueued Resource ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 with Priority: HIGHEST for action security_group_rules [ 1145.906797] env[69506]: INFO networking_nsxv3.common.synchronization [req-b1cfb184-c9ba-4140-b100-73f6aa287f6e req-24cee4d5-6c07-4e1a-b799-24f10b804c0b service nova] Enqueued Resource ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 with Priority: HIGHEST for action security_group_members [ 1145.906862] env[69506]: INFO networking_nsxv3.common.synchronization [req-b1cfb184-c9ba-4140-b100-73f6aa287f6e req-24cee4d5-6c07-4e1a-b799-24f10b804c0b service nova] Enqueued Resource ID: d72f1939-13ab-439e-906a-8f70660883c7 with Priority: HIGHEST for action port [ 1145.907633] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 with Priority: HIGHEST for action security_group_rules [ 1145.907788] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 with Priority: HIGHEST for action security_group_members [ 1145.907902] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d72f1939-13ab-439e-906a-8f70660883c7 with Priority: HIGHEST for action port [ 1145.908212] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-74f7fdee-99f0-4620-9ae9-86ee28797058 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.908338] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.908402] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.908630] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.908713] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('74f7fdee-99f0-4620-9ae9-86ee28797058',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.909781] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-74f7fdee-99f0-4620-9ae9-86ee28797058 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.909873] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.909873] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.910075] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.910251] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.910348] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.910407] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.910657] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.910657] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.910741] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74f7fdee-99f0-4620-9ae9-86ee28797058',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.911711] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-d72f1939-13ab-439e-906a-8f70660883c7 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.911833] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d72f1939-13ab-439e-906a-8f70660883c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.911916] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d72f1939-13ab-439e-906a-8f70660883c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.912168] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d72f1939-13ab-439e-906a-8f70660883c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.912595] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d72f1939-13ab-439e-906a-8f70660883c7',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.413782] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-74f7fdee-99f0-4620-9ae9-86ee28797058 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.413986] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.414201] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('74f7fdee-99f0-4620-9ae9-86ee28797058',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.415792] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d72f1939-13ab-439e-906a-8f70660883c7 with status ACTIVE [ 1146.415792] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.415792] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.415792] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.415932] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.416017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.416266] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.416356] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.416464] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.416605] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.417450] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.417450] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.417450] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.417450] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.417450] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.417450] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.417450] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d72f1939-13ab-439e-906a-8f70660883c7 is going to be updated. [ 1146.437530] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.437530] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.437738] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.437877] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.437991] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.438215] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d72f1939-13ab-439e-906a-8f70660883c7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.904727] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 in Status: SUCCESS [ 1146.904902] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 deletion is rescheduled due to dependency. [ 1146.904987] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.919663] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('74f7fdee-99f0-4620-9ae9-86ee28797058',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.097560] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: SUCCESS [ 1147.097560] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.097560] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.097560] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.097560] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.097560] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.097560] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.098138] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.098138] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.099575] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.099575] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.411308] env[69506]: INFO networking_nsxv3.common.synchronization [req-b1cfb184-c9ba-4140-b100-73f6aa287f6e req-d8685873-ced0-4a3f-a51d-e62a69a24c8d tempest-MultipleCreateTestJSON-427740631 tempest-MultipleCreateTestJSON-427740631-project-member] Enqueued Resource ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 with Priority: HIGHEST for action security_group_members [ 1147.412050] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 with Priority: HIGHEST for action security_group_members [ 1147.412384] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-74f7fdee-99f0-4620-9ae9-86ee28797058 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.412500] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.421945] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.422112] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.422186] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.422411] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.422524] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.422661] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 is going to be created. [ 1147.447068] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.447068] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.447068] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.447068] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.447068] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.454713] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 in Status: UNINITIALIZED for 2s [ 1147.604032] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.604032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.604032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.604032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.604032] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.604032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.604032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.604032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.604032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.604032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.604032] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.604032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.604032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.604032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.604032] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.604032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.604710] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.604710] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.604710] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.604710] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.604710] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.731098] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-821 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.731319] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-821" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.731451] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-821" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.731905] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-821" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.732259] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.732443] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.732572] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.732816] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.732967] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.733824] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1147.734013] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1147.734148] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1147.734268] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1147.734392] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1147.734522] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1147.734673] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1147.752078] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1147.752348] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1147.752552] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1147.752759] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-821" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.753579] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-5aa39b2e-b82a-4277-874e-112b283ee65d taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.753579] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-5aa39b2e-b82a-4277-874e-112b283ee65d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.753579] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-5aa39b2e-b82a-4277-874e-112b283ee65d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.754031] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-5aa39b2e-b82a-4277-874e-112b283ee65d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.754091] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5aa39b2e-b82a-4277-874e-112b283ee65d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.107397] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc: rpc.has_security_group_logging(os_id): False [ 1148.125405] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.125597] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.125663] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.125875] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.144438] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.144694] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.144867] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.144867] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.145142] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.145178] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.145399] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.145606] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.145606] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.145721] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.145800] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.145980] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.146086] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.146161] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.146303] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.146379] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.146467] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc is going to be updated. [ 1148.204993] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.205229] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.205229] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.205441] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.205576] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.220333] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: IN_PROGRESS for 2s [ 1148.257185] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.257394] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.257508] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.257899] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.258081] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.258251] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 5aa39b2e-b82a-4277-874e-112b283ee65d not found, creating... [ 1148.258527] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.258718] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.258843] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.259101] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.259276] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.259598] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.259769] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.259912] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.260160] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.260303] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.260476] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 5aa39b2e-b82a-4277-874e-112b283ee65d is going to be created. [ 1148.285135] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.285365] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.285497] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.285769] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.285998] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.286243] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-5aa39b2e-b82a-4277-874e-112b283ee65d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.078184] env[69506]: INFO networking_nsxv3.common.synchronization [req-b1cfb184-c9ba-4140-b100-73f6aa287f6e req-7545b81b-37d5-4b98-b5fe-4986e7b10cc4 service nova] Enqueued Resource ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 with Priority: HIGHEST for action security_group_rules [ 1149.078427] env[69506]: INFO networking_nsxv3.common.synchronization [req-b1cfb184-c9ba-4140-b100-73f6aa287f6e req-7545b81b-37d5-4b98-b5fe-4986e7b10cc4 service nova] Enqueued Resource ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 with Priority: HIGHEST for action security_group_members [ 1149.078556] env[69506]: INFO networking_nsxv3.common.synchronization [req-b1cfb184-c9ba-4140-b100-73f6aa287f6e req-7545b81b-37d5-4b98-b5fe-4986e7b10cc4 service nova] Enqueued Resource ID: 5aa39b2e-b82a-4277-874e-112b283ee65d with Priority: HIGHEST for action port [ 1149.079132] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 with Priority: HIGHEST for action security_group_rules [ 1149.079263] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 with Priority: HIGHEST for action security_group_members [ 1149.079362] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5aa39b2e-b82a-4277-874e-112b283ee65d with Priority: HIGHEST for action port [ 1149.079757] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-74f7fdee-99f0-4620-9ae9-86ee28797058 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.079882] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.080291] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-74f7fdee-99f0-4620-9ae9-86ee28797058 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.080391] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.080590] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-5aa39b2e-b82a-4277-874e-112b283ee65d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.080692] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5aa39b2e-b82a-4277-874e-112b283ee65d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.080756] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5aa39b2e-b82a-4277-874e-112b283ee65d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.080979] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5aa39b2e-b82a-4277-874e-112b283ee65d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.081070] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5aa39b2e-b82a-4277-874e-112b283ee65d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.463656] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 in Status: SUCCESS [ 1149.463656] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.464031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.464031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.464288] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.464440] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.464512] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.464675] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.464758] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.464843] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.464941] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('74f7fdee-99f0-4620-9ae9-86ee28797058',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.465796] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.465942] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.466549] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.466888] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.466888] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.466888] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.467130] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.467130] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74f7fdee-99f0-4620-9ae9-86ee28797058',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.583264] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5aa39b2e-b82a-4277-874e-112b283ee65d with status ACTIVE [ 1149.583264] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.583264] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.583264] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.583545] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.583545] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.583728] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.583794] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.583823] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.583956] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.584044] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.584222] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.584329] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.584391] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.584515] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.584568] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.585659] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5aa39b2e-b82a-4277-874e-112b283ee65d is going to be updated. [ 1149.603852] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.604023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.604101] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.604924] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.604924] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.604924] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5aa39b2e-b82a-4277-874e-112b283ee65d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.968418] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-74f7fdee-99f0-4620-9ae9-86ee28797058 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.968902] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.968902] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('74f7fdee-99f0-4620-9ae9-86ee28797058',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.233177] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: SUCCESS [ 1150.233432] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.471400] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('74f7fdee-99f0-4620-9ae9-86ee28797058',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.974767] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.974767] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.974924] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.975062] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.975159] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.975261] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 is going to be updated. [ 1151.000448] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.000596] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.000804] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.001025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.001168] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.009198] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 in Status: IN_PROGRESS for 2s [ 1153.019504] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 in Status: SUCCESS [ 1153.019797] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.019968] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.020210] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.020438] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.020516] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.020578] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.020734] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.020832] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.020919] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74f7fdee-99f0-4620-9ae9-86ee28797058',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.523147] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('74f7fdee-99f0-4620-9ae9-86ee28797058',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.892728] env[69506]: INFO networking_nsxv3.common.synchronization [req-a31f3546-8a82-43d3-a29a-cc3465c39b97 req-1ea30c2e-9047-4ba3-907e-41485636f781 tempest-ServersTestJSON-1801092994 tempest-ServersTestJSON-1801092994-project-member] Enqueued Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 1153.893374] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 1153.894034] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.894034] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.894034] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.894197] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.894425] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.894557] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.894771] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.894771] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.894863] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.894953] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.025898] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('74f7fdee-99f0-4620-9ae9-86ee28797058',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.397093] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.527560] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.527874] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.527952] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.528162] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.528260] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.528360] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 is going to be updated. [ 1154.555228] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.555372] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.555445] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.555659] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.555807] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.563532] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 in Status: IN_PROGRESS for 2s [ 1154.899780] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.402999] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.403331] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.403331] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.403485] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.403626] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.403742] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc is going to be updated. [ 1155.428968] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.429124] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.429181] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.429379] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.429527] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.437725] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: IN_PROGRESS for 2s [ 1156.217916] env[69506]: INFO networking_nsxv3.common.synchronization [req-9982292a-40c1-48ab-8120-13886af3e38f req-44a9b7d1-1115-49e9-b8f3-8f3da2ac76a5 tempest-ServerActionsTestOtherB-347258904 tempest-ServerActionsTestOtherB-347258904-project-member] Enqueued Resource ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 with Priority: HIGHEST for action security_group_members [ 1156.218558] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 with Priority: HIGHEST for action security_group_members [ 1156.220410] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.220410] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.220410] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.220410] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.220410] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.220410] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.220410] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.220410] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.220410] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.220410] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fca9cd47-c1fb-4023-8f12-fa1b22a98fd8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.524875] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-697 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.525197] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-697" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.525304] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-697" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.525548] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-697" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.525750] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.525914] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.526052] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.526279] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.526431] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.526660] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1156.526783] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1156.526898] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1156.527027] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1156.527152] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1156.527265] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1156.527407] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1156.544849] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1156.545032] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1156.545195] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1156.545391] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-697" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.545756] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-f3c16c0c-aa52-4ccc-8f50-305eb5529b34 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.545946] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-f3c16c0c-aa52-4ccc-8f50-305eb5529b34" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.546098] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-f3c16c0c-aa52-4ccc-8f50-305eb5529b34" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.546392] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-f3c16c0c-aa52-4ccc-8f50-305eb5529b34" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.546535] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3c16c0c-aa52-4ccc-8f50-305eb5529b34',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.571610] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 in Status: SUCCESS [ 1156.571927] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.572051] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.572251] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.572439] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.572551] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.572620] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.572790] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.572875] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.572963] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.573133] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-74f7fdee-99f0-4620-9ae9-86ee28797058 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.573227] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.573290] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.573433] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.573569] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.573659] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.573721] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.573854] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.573925] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.574012] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.574104] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('74f7fdee-99f0-4620-9ae9-86ee28797058',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.722063] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.722063] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.722308] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.722342] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.722484] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.722748] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.722890] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.722991] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.723192] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.723302] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.723412] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 is going to be updated. [ 1156.747733] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.747887] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.747957] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.748179] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.748339] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.756019] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 in Status: IN_PROGRESS for 2s [ 1157.048418] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.048752] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.048933] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.049240] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.049400] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.049578] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port f3c16c0c-aa52-4ccc-8f50-305eb5529b34 not found, creating... [ 1157.049866] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.050043] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.050167] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.050418] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.050664] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.050814] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.050974] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.051188] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.051409] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.051552] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.051767] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: f3c16c0c-aa52-4ccc-8f50-305eb5529b34 is going to be created. [ 1157.070034] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.070230] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.070362] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.070597] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.070820] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.071051] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-f3c16c0c-aa52-4ccc-8f50-305eb5529b34" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.075537] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 74f7fdee-99f0-4620-9ae9-86ee28797058: rpc.has_security_group_logging(os_id): False [ 1157.090774] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.090890] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.090958] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.091161] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.091247] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.091449] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.091550] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.091615] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.091931] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.092044] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.092257] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.092365] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.092433] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.092585] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.092690] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.092951] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.093101] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.093191] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.093386] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.093495] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.093614] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 is going to be created. [ 1157.173322] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.173511] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.173557] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.173736] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.173916] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.191322] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 in Status: IN_PROGRESS for 2s [ 1157.448677] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: SUCCESS [ 1157.448969] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.749968] env[69506]: INFO networking_nsxv3.common.synchronization [req-9982292a-40c1-48ab-8120-13886af3e38f req-bfd8ce4c-388b-4cef-8859-fa6d0abc2eaa service nova] Enqueued Resource ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 with Priority: HIGHEST for action security_group_rules [ 1157.750294] env[69506]: INFO networking_nsxv3.common.synchronization [req-9982292a-40c1-48ab-8120-13886af3e38f req-bfd8ce4c-388b-4cef-8859-fa6d0abc2eaa service nova] Enqueued Resource ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 with Priority: HIGHEST for action security_group_members [ 1157.750410] env[69506]: INFO networking_nsxv3.common.synchronization [req-9982292a-40c1-48ab-8120-13886af3e38f req-bfd8ce4c-388b-4cef-8859-fa6d0abc2eaa service nova] Enqueued Resource ID: f3c16c0c-aa52-4ccc-8f50-305eb5529b34 with Priority: HIGHEST for action port [ 1157.750906] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 with Priority: HIGHEST for action security_group_rules [ 1157.751160] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 with Priority: HIGHEST for action security_group_members [ 1157.751297] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c16c0c-aa52-4ccc-8f50-305eb5529b34 with Priority: HIGHEST for action port [ 1157.751578] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.752305] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.752305] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.752305] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.752305] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fca9cd47-c1fb-4023-8f12-fa1b22a98fd8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.753615] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.753615] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.754062] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3c16c0c-aa52-4ccc-8f50-305eb5529b34 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.754184] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3c16c0c-aa52-4ccc-8f50-305eb5529b34" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.754250] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3c16c0c-aa52-4ccc-8f50-305eb5529b34" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.754544] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3c16c0c-aa52-4ccc-8f50-305eb5529b34" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.754626] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3c16c0c-aa52-4ccc-8f50-305eb5529b34',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.254325] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.254325] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.257040] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f3c16c0c-aa52-4ccc-8f50-305eb5529b34 with status ACTIVE [ 1158.257040] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.257040] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.257040] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.257239] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.257335] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.257487] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.257586] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.257644] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.258379] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.258379] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.258379] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.258379] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.258379] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.258379] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.258627] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.258627] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f3c16c0c-aa52-4ccc-8f50-305eb5529b34 is going to be updated. [ 1158.285966] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.286142] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.286200] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.286344] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.286472] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.286626] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3c16c0c-aa52-4ccc-8f50-305eb5529b34" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.765436] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 in Status: SUCCESS [ 1158.765737] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 deletion is rescheduled due to dependency. [ 1158.765737] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.765854] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.766077] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.766265] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.766380] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.766448] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.766633] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.766718] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.766819] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fca9cd47-c1fb-4023-8f12-fa1b22a98fd8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.047832] env[69506]: INFO networking_nsxv3.common.synchronization [req-43e9c90c-e048-4e75-b734-2d3747476b0a req-b122de32-9fa6-47fb-80a6-d8ea20722b38 tempest-DeleteServersTestJSON-1880805458 tempest-DeleteServersTestJSON-1880805458-project-member] Enqueued Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_members [ 1159.048473] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_members [ 1159.048811] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.048968] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.049049] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.049280] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.049397] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.049527] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.049594] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.049753] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.049906] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.050012] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.205807] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 in Status: SUCCESS [ 1159.205953] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.206175] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.206344] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.206433] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('74f7fdee-99f0-4620-9ae9-86ee28797058',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.352562] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fca9cd47-c1fb-4023-8f12-fa1b22a98fd8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.553226] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.553364] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.553443] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.553771] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.553884] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.554213] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.554382] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.554491] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.554734] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.554817] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.554931] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d is going to be updated. [ 1159.581937] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.582109] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.582189] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.582404] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.582542] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.590975] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: IN_PROGRESS for 2s [ 1159.710514] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-74f7fdee-99f0-4620-9ae9-86ee28797058 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.710680] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.710753] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.711012] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.711202] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.711313] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.711377] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.711538] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.711624] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.711736] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.711833] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('74f7fdee-99f0-4620-9ae9-86ee28797058',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.855071] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fca9cd47-c1fb-4023-8f12-fa1b22a98fd8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.213985] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-74f7fdee-99f0-4620-9ae9-86ee28797058 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.214186] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.214230] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.214470] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.214648] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.214786] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.214856] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.215035] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.215127] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.215218] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.215369] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-74f7fdee-99f0-4620-9ae9-86ee28797058 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.215460] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.215522] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.215664] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.215798] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.215887] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.215946] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.216091] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.216166] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.216243] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.216330] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('74f7fdee-99f0-4620-9ae9-86ee28797058',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.357712] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.357878] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.357878] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.358112] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.358203] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.358304] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 is going to be updated. [ 1160.384283] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.384427] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.384471] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.384668] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.384806] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.392345] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 in Status: IN_PROGRESS for 2s [ 1160.681562] env[69506]: INFO networking_nsxv3.common.synchronization [req-1c65556a-1dfe-4eaf-a4c9-0b9c086a3369 req-e16ece99-c508-4f73-99f2-9aa9915ab70d tempest-MultipleCreateTestJSON-427740631 tempest-MultipleCreateTestJSON-427740631-project-member] Enqueued Resource ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 with Priority: HIGHEST for action security_group_members [ 1160.681562] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 with Priority: HIGHEST for action security_group_members [ 1160.681562] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-74f7fdee-99f0-4620-9ae9-86ee28797058 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.681562] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.681562] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.681562] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.681562] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.681562] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.681988] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.681988] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.681988] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.682094] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74f7fdee-99f0-4620-9ae9-86ee28797058',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.718972] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 74f7fdee-99f0-4620-9ae9-86ee28797058: rpc.has_security_group_logging(os_id): False [ 1160.735029] env[69506]: INFO networking_nsxv3.common.synchronization [req-ed61f0b3-f47f-4646-92bb-5b14ca1149b7 req-79c433f4-ef75-427a-ba8a-c7a3b9072b39 tempest-MultipleCreateTestJSON-427740631 tempest-MultipleCreateTestJSON-427740631-project-member] Enqueued Resource ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 with Priority: HIGHEST for action security_group_members [ 1160.736075] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.736204] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.736275] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.736474] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.736562] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.736774] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.736872] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.736934] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.737089] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.737164] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.737338] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.737427] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.737488] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.737622] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.737695] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.737873] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.737963] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.738034] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.738170] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.738243] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.738326] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 is going to be updated. [ 1160.739551] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 with Priority: HIGHEST for action security_group_members [ 1160.739834] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-74f7fdee-99f0-4620-9ae9-86ee28797058 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.739926] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.797107] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.797361] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.797361] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.797515] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.797657] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.812095] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 in Status: IN_PROGRESS for 2s [ 1161.184436] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('74f7fdee-99f0-4620-9ae9-86ee28797058',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.259419] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-324 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.259635] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-324" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.259764] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-324" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.260055] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-324" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.260319] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.260497] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.260596] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.260811] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.261054] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.261401] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1161.261613] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1161.261832] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1161.262048] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1161.262226] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1161.262391] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1161.262610] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1161.281144] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1161.281363] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1161.281520] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1161.281749] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-324" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.282107] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-bf5a8cb7-b206-46b1-8d38-092266d7ca57 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.282289] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-bf5a8cb7-b206-46b1-8d38-092266d7ca57" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.282413] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-bf5a8cb7-b206-46b1-8d38-092266d7ca57" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.282672] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-bf5a8cb7-b206-46b1-8d38-092266d7ca57" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.282848] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf5a8cb7-b206-46b1-8d38-092266d7ca57',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.600349] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: SUCCESS [ 1161.600534] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d deletion is rescheduled due to dependency. [ 1161.600742] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.687267] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('74f7fdee-99f0-4620-9ae9-86ee28797058',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.785140] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.785366] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.785517] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.785822] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.785995] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.786350] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.786528] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.786660] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.786908] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.787084] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.787437] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.787631] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.787777] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.788051] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.788210] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.788377] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: bf5a8cb7-b206-46b1-8d38-092266d7ca57 is going to be updated. [ 1161.822378] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.822608] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.822785] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.823055] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.823349] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.823570] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-bf5a8cb7-b206-46b1-8d38-092266d7ca57" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.190044] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.190321] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.190321] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.190537] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.190627] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.190734] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 is going to be updated. [ 1162.222790] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.222932] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.223019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.223299] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.223495] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.232252] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 in Status: IN_PROGRESS for 2s [ 1162.405210] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 in Status: SUCCESS [ 1162.405441] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.406224] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.406224] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.406224] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.406397] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.406397] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.406540] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.406643] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.406759] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.407417] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fca9cd47-c1fb-4023-8f12-fa1b22a98fd8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.519657] env[69506]: INFO networking_nsxv3.common.synchronization [req-568d7ce9-4c8e-4e7e-9d60-012ed7c53363 req-6dc9dd2e-1756-4b3e-a2ed-d8640c087277 service nova] Enqueued Resource ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca with Priority: HIGHEST for action security_group_rules [ 1162.519657] env[69506]: INFO networking_nsxv3.common.synchronization [req-568d7ce9-4c8e-4e7e-9d60-012ed7c53363 req-6dc9dd2e-1756-4b3e-a2ed-d8640c087277 service nova] Enqueued Resource ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca with Priority: HIGHEST for action security_group_members [ 1162.519657] env[69506]: INFO networking_nsxv3.common.synchronization [req-568d7ce9-4c8e-4e7e-9d60-012ed7c53363 req-6dc9dd2e-1756-4b3e-a2ed-d8640c087277 service nova] Enqueued Resource ID: bf5a8cb7-b206-46b1-8d38-092266d7ca57 with Priority: HIGHEST for action port [ 1162.519657] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca with Priority: HIGHEST for action security_group_rules [ 1162.519657] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca with Priority: HIGHEST for action security_group_members [ 1162.519657] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf5a8cb7-b206-46b1-8d38-092266d7ca57 with Priority: HIGHEST for action port [ 1162.519657] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0461c6a-1d2b-401e-b59f-af6eda84b6ca taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.519657] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.519657] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.519657] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.519657] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0461c6a-1d2b-401e-b59f-af6eda84b6ca',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.519657] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.520340] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.520340] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.520340] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.520340] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.520340] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.520340] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.520543] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.520543] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.520627] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0461c6a-1d2b-401e-b59f-af6eda84b6ca',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.521325] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf5a8cb7-b206-46b1-8d38-092266d7ca57 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.521952] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf5a8cb7-b206-46b1-8d38-092266d7ca57" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.521952] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf5a8cb7-b206-46b1-8d38-092266d7ca57" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.521952] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf5a8cb7-b206-46b1-8d38-092266d7ca57" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.521952] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf5a8cb7-b206-46b1-8d38-092266d7ca57',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.826664] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 in Status: SUCCESS [ 1162.826925] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.911985] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fca9cd47-c1fb-4023-8f12-fa1b22a98fd8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.024425] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.024425] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.024425] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0461c6a-1d2b-401e-b59f-af6eda84b6ca',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.025282] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf5a8cb7-b206-46b1-8d38-092266d7ca57 with status ACTIVE [ 1163.025464] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.025591] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.025664] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.025842] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.025929] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.026117] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.026206] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.026268] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.026414] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.026488] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.026667] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.026761] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.026823] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.026964] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.027048] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.027133] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf5a8cb7-b206-46b1-8d38-092266d7ca57 is going to be updated. [ 1163.045952] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.046166] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.046166] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.046785] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.046785] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.046785] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf5a8cb7-b206-46b1-8d38-092266d7ca57" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.414036] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fca9cd47-c1fb-4023-8f12-fa1b22a98fd8: rpc.has_security_group_logging(os_id): False [ 1163.432138] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.432383] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.432501] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.432808] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.432957] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.433307] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.433435] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.433522] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.433739] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.433882] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.433951] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 is going to be updated. [ 1163.516538] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.516700] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.516772] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.517072] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.517282] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.528915] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0461c6a-1d2b-401e-b59f-af6eda84b6ca',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.532851] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 in Status: IN_PROGRESS for 2s [ 1164.031125] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.031299] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.031373] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.031609] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.031702] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.031846] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca is going to be updated. [ 1164.058511] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.058709] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.058709] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.058827] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.058962] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.066745] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca in Status: IN_PROGRESS for 2s [ 1164.241627] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 in Status: SUCCESS [ 1164.241927] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.242105] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.242351] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.242690] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.242690] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.242875] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.242910] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.242994] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.243102] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74f7fdee-99f0-4620-9ae9-86ee28797058',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.745832] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.746100] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.746100] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.746973] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.747120] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.747343] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.747461] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.747517] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.747694] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.747789] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.747879] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 is going to be updated. [ 1164.770859] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.771008] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.771089] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.771575] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.771575] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.778874] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 in Status: IN_PROGRESS for 2s [ 1165.545999] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 in Status: SUCCESS [ 1165.546255] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.076432] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca in Status: SUCCESS [ 1166.076432] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.076719] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.076802] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.077023] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.077143] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.077209] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.077371] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.077449] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.077563] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.077634] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0461c6a-1d2b-401e-b59f-af6eda84b6ca',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.581151] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.581151] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.581151] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.581151] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.581151] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.581151] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.581423] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.581423] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.581491] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.581523] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.582518] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.582518] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.582518] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.582518] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.582518] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.582518] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.582518] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.582518] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.583031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.583031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.583031] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0461c6a-1d2b-401e-b59f-af6eda84b6ca',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.789554] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 in Status: SUCCESS [ 1166.789554] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 deletion is rescheduled due to dependency. [ 1166.789554] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.086138] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0461c6a-1d2b-401e-b59f-af6eda84b6ca: rpc.has_security_group_logging(os_id): False [ 1167.103627] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.103789] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.103865] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.104137] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.104800] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.104800] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.104800] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.104800] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.104800] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.105035] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.105035] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.105102] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.105192] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.105287] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.105355] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.105546] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.105639] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.105694] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.105841] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.105932] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.106030] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca is going to be updated. [ 1167.172023] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.172202] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.172245] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.174031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.174031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.207489] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca in Status: IN_PROGRESS for 2s [ 1167.518729] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1167.519016] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1169.227697] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca in Status: SUCCESS [ 1169.228098] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.158497] env[69506]: INFO networking_nsxv3.common.synchronization [req-b3ad08d6-1269-4673-84c8-5c5ecbcce4fd req-14ef20fa-61b1-498e-81e6-0beb4a526055 tempest-DeleteServersTestJSON-1880805458 tempest-DeleteServersTestJSON-1880805458-project-member] Enqueued Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_members [ 1170.159087] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_members [ 1170.159432] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.159589] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.159657] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.159870] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.161420] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.161420] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.161420] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.161420] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.161420] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.161420] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.448925] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-628 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.449261] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-628" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.449261] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-628" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.449530] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-628" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.449820] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.449973] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.450115] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.450353] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.450507] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.450716] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1170.450832] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1170.450969] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1170.451119] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1170.451188] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1170.451270] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1170.451406] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1170.472178] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1170.472424] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1170.472601] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1170.472814] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-628" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.473157] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-8382640e-873b-4a7b-80a9-38db6af2c170 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.473342] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-8382640e-873b-4a7b-80a9-38db6af2c170" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.473469] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-8382640e-873b-4a7b-80a9-38db6af2c170" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.473824] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-8382640e-873b-4a7b-80a9-38db6af2c170" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.473981] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8382640e-873b-4a7b-80a9-38db6af2c170',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.663505] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.663660] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.663733] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.663948] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.664055] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.664281] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.664384] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.664435] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.664586] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.664666] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.664756] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d is going to be updated. [ 1170.689333] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.689472] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.689515] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.689685] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.689849] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.697886] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: IN_PROGRESS for 2s [ 1170.976501] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.976756] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.976931] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.977244] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.977403] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.977606] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 8382640e-873b-4a7b-80a9-38db6af2c170 not found, creating... [ 1170.977858] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.978369] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.978369] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.978369] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.978517] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.978721] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.978880] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.979011] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.979231] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.979373] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.979516] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 8382640e-873b-4a7b-80a9-38db6af2c170 is going to be created. [ 1171.000593] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-868 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.000797] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-868" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.000928] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-868" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.001186] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-868" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.001442] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.001599] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.001720] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.001967] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.002132] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.002340] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1171.002457] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1171.002568] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1171.002676] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1171.002812] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1171.002933] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1171.003109] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1171.009180] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.009381] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.009526] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.009752] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.009974] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.010210] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-8382640e-873b-4a7b-80a9-38db6af2c170" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.028772] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1171.028923] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1171.029080] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1171.029241] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-868" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.029508] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-1287a7a9-2d9b-4056-a099-bfaf1bbe9a67 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.029668] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-1287a7a9-2d9b-4056-a099-bfaf1bbe9a67" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.029808] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-1287a7a9-2d9b-4056-a099-bfaf1bbe9a67" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.030133] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-1287a7a9-2d9b-4056-a099-bfaf1bbe9a67" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.030280] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1287a7a9-2d9b-4056-a099-bfaf1bbe9a67',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.532435] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.532792] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.532792] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.533082] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.533243] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.533406] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 1287a7a9-2d9b-4056-a099-bfaf1bbe9a67 not found, creating... [ 1171.533667] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.533827] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.533951] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.534199] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.534343] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.534633] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.534789] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.534909] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.535142] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.535282] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.535434] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 1287a7a9-2d9b-4056-a099-bfaf1bbe9a67 is going to be created. [ 1171.554296] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.554512] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.554657] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.554885] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.555155] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.555369] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-1287a7a9-2d9b-4056-a099-bfaf1bbe9a67" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.678275] env[69506]: INFO networking_nsxv3.common.synchronization [req-b3ad08d6-1269-4673-84c8-5c5ecbcce4fd req-2e6c7e2c-c754-4ddb-b642-740fcdf862fa service nova] Enqueued Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_rules [ 1171.678275] env[69506]: INFO networking_nsxv3.common.synchronization [req-b3ad08d6-1269-4673-84c8-5c5ecbcce4fd req-2e6c7e2c-c754-4ddb-b642-740fcdf862fa service nova] Enqueued Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_members [ 1171.678275] env[69506]: INFO networking_nsxv3.common.synchronization [req-b3ad08d6-1269-4673-84c8-5c5ecbcce4fd req-2e6c7e2c-c754-4ddb-b642-740fcdf862fa service nova] Enqueued Resource ID: 8382640e-873b-4a7b-80a9-38db6af2c170 with Priority: HIGHEST for action port [ 1171.678275] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_rules [ 1171.678275] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_members [ 1171.678275] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8382640e-873b-4a7b-80a9-38db6af2c170 with Priority: HIGHEST for action port [ 1171.678672] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.678783] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.678851] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.679065] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.679148] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.680027] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.680737] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.680737] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-8382640e-873b-4a7b-80a9-38db6af2c170 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.680737] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8382640e-873b-4a7b-80a9-38db6af2c170" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.680956] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8382640e-873b-4a7b-80a9-38db6af2c170" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.680956] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8382640e-873b-4a7b-80a9-38db6af2c170" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.681070] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8382640e-873b-4a7b-80a9-38db6af2c170',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.182524] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.182670] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.183200] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8382640e-873b-4a7b-80a9-38db6af2c170 with status ACTIVE [ 1172.183200] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.183381] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.183381] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.183589] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.183628] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.184011] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.184011] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.184011] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.184221] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.184221] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.184368] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.186966] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.187043] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.187546] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.187546] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.187546] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8382640e-873b-4a7b-80a9-38db6af2c170 is going to be updated. [ 1172.212674] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.213168] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.213258] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.213497] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.213699] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.214299] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8382640e-873b-4a7b-80a9-38db6af2c170" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.276889] env[69506]: INFO networking_nsxv3.common.synchronization [req-3b5cdac5-e755-4de3-87ba-57fca8157288 req-423aad26-538b-43fe-8336-92ed2723c06b service nova] Enqueued Resource ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 with Priority: HIGHEST for action security_group_rules [ 1172.276986] env[69506]: INFO networking_nsxv3.common.synchronization [req-3b5cdac5-e755-4de3-87ba-57fca8157288 req-423aad26-538b-43fe-8336-92ed2723c06b service nova] Enqueued Resource ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 with Priority: HIGHEST for action security_group_members [ 1172.277115] env[69506]: INFO networking_nsxv3.common.synchronization [req-3b5cdac5-e755-4de3-87ba-57fca8157288 req-423aad26-538b-43fe-8336-92ed2723c06b service nova] Enqueued Resource ID: 1287a7a9-2d9b-4056-a099-bfaf1bbe9a67 with Priority: HIGHEST for action port [ 1172.277357] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 with Priority: HIGHEST for action security_group_rules [ 1172.277487] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 with Priority: HIGHEST for action security_group_members [ 1172.277584] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1287a7a9-2d9b-4056-a099-bfaf1bbe9a67 with Priority: HIGHEST for action port [ 1172.278519] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f946d66-543a-40be-9347-81d7eb4f4e31 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.278656] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.278726] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.278938] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.279033] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.280037] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f946d66-543a-40be-9347-81d7eb4f4e31 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.280140] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.280140] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.280332] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.280488] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.280584] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.280651] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.281522] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.281619] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.281975] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.283671] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-1287a7a9-2d9b-4056-a099-bfaf1bbe9a67 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.283671] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1287a7a9-2d9b-4056-a099-bfaf1bbe9a67" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.283671] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1287a7a9-2d9b-4056-a099-bfaf1bbe9a67" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.283671] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1287a7a9-2d9b-4056-a099-bfaf1bbe9a67" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.283671] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1287a7a9-2d9b-4056-a099-bfaf1bbe9a67',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.397178] env[69506]: INFO networking_nsxv3.common.synchronization [req-4c01c439-2b80-46b9-aefe-575a4c6d0e2d req-f6d4d4ca-a7af-4f83-ab34-9800976a403c tempest-ServersTestJSON-1801092994 tempest-ServersTestJSON-1801092994-project-member] Enqueued Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 1172.397762] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 1172.398107] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.398266] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.398366] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.398509] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.400032] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.400198] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.400263] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.400452] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.400591] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.400770] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.700422] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-54 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.700770] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-54" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.700770] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-54" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.701021] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-54" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.701290] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.701456] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.701706] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.701816] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.702041] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.703017] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1172.703017] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1172.703017] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1172.703017] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1172.703017] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1172.703017] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1172.703297] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1172.715272] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: SUCCESS [ 1172.715440] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d deletion is rescheduled due to dependency. [ 1172.715557] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.715716] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.715925] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.716122] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.716238] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.716302] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.716459] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.716540] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.716636] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.723261] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1172.723481] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1172.723631] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1172.723811] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-54" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.724201] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-8da87d2e-a30a-4973-b368-ef055f87371a taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.724578] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-8da87d2e-a30a-4973-b368-ef055f87371a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.724578] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-8da87d2e-a30a-4973-b368-ef055f87371a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.724859] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-8da87d2e-a30a-4973-b368-ef055f87371a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.725009] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8da87d2e-a30a-4973-b368-ef055f87371a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.786894] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.788038] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f946d66-543a-40be-9347-81d7eb4f4e31 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.788158] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.788595] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1287a7a9-2d9b-4056-a099-bfaf1bbe9a67 with status ACTIVE [ 1172.788768] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.788877] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.788944] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.789225] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.789335] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.789522] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.789618] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.789680] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.789867] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.789947] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.790131] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.790222] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.790283] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.790488] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.790563] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.790652] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1287a7a9-2d9b-4056-a099-bfaf1bbe9a67 is going to be updated. [ 1172.813651] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.813867] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.813914] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.814157] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.814292] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.814455] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1287a7a9-2d9b-4056-a099-bfaf1bbe9a67" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.904279] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.219602] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.227976] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.228243] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.228378] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.228766] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.228937] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.229118] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 8da87d2e-a30a-4973-b368-ef055f87371a not found, creating... [ 1173.229405] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.229627] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.229760] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.230073] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.230284] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.230681] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.230847] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.230971] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.231217] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.231421] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.231579] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 8da87d2e-a30a-4973-b368-ef055f87371a is going to be created. [ 1173.256906] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.257177] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.257353] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.257722] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.257965] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.258227] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-8da87d2e-a30a-4973-b368-ef055f87371a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.289466] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.405989] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.722133] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.791552] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.791773] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.791773] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.792044] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.792148] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.792259] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 is going to be updated. [ 1173.823404] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.823585] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.823711] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.824043] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.824286] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.835354] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 in Status: IN_PROGRESS for 2s [ 1173.908746] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.909108] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.909225] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.909541] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.909680] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.909881] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc is going to be updated. [ 1173.956105] env[69506]: INFO networking_nsxv3.common.synchronization [req-4c01c439-2b80-46b9-aefe-575a4c6d0e2d req-861a1a38-c254-42bb-b5c6-64c7ee10c791 service nova] Enqueued Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_rules [ 1173.956382] env[69506]: INFO networking_nsxv3.common.synchronization [req-4c01c439-2b80-46b9-aefe-575a4c6d0e2d req-861a1a38-c254-42bb-b5c6-64c7ee10c791 service nova] Enqueued Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 1173.956602] env[69506]: INFO networking_nsxv3.common.synchronization [req-4c01c439-2b80-46b9-aefe-575a4c6d0e2d req-861a1a38-c254-42bb-b5c6-64c7ee10c791 service nova] Enqueued Resource ID: 8da87d2e-a30a-4973-b368-ef055f87371a with Priority: HIGHEST for action port [ 1173.957800] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.957938] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.958028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.958226] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.958365] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.959727] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_rules [ 1173.959957] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 1173.960061] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8da87d2e-a30a-4973-b368-ef055f87371a with Priority: HIGHEST for action port [ 1173.960357] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.960467] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.960532] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.960706] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.960789] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.961707] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.961795] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.962049] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-8da87d2e-a30a-4973-b368-ef055f87371a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.962148] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8da87d2e-a30a-4973-b368-ef055f87371a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.962212] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8da87d2e-a30a-4973-b368-ef055f87371a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.962363] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8da87d2e-a30a-4973-b368-ef055f87371a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.962439] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8da87d2e-a30a-4973-b368-ef055f87371a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.973122] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: IN_PROGRESS for 2s [ 1174.225141] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.225283] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.225348] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.225560] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.225649] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.225749] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d is going to be updated. [ 1174.256849] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.256979] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.257066] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.257329] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.257491] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.270134] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: IN_PROGRESS for 2s [ 1174.465278] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.465278] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.465278] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8da87d2e-a30a-4973-b368-ef055f87371a with status ACTIVE [ 1174.465278] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.465278] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.465278] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.465640] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.465640] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.465904] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.465904] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.465904] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.466131] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.466178] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.466329] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.466440] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.466493] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.466673] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.466754] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.466845] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8da87d2e-a30a-4973-b368-ef055f87371a is going to be updated. [ 1174.490112] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.490272] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.490315] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.490502] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.490630] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.490779] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8da87d2e-a30a-4973-b368-ef055f87371a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.845604] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 in Status: SUCCESS [ 1175.845894] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.846030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.846260] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.846461] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.846581] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.846643] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.846798] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.846879] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.846967] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.847077] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.982233] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: SUCCESS [ 1175.982402] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.982598] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.982847] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.982987] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.983115] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.983175] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.983331] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.983549] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.983549] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.279019] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: SUCCESS [ 1176.279270] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.279439] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.279656] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.279864] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.279990] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.280076] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.280232] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.280316] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.280400] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.280492] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.349579] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f946d66-543a-40be-9347-81d7eb4f4e31 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.349579] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.349765] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.350092] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.350407] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.350615] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.350763] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.351047] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.351223] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.351404] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.351667] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f946d66-543a-40be-9347-81d7eb4f4e31 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.351791] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.351873] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.352095] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.352605] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.352605] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.352605] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.352605] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.353066] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.353066] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.353066] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.485511] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.782813] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.782813] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.782813] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.783037] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.784356] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.784356] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.784356] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.784356] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.784356] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.784356] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.784356] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.784356] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.784356] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.784356] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.784356] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.784356] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.784806] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.784806] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.784806] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.784806] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.784806] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.856027] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3f946d66-543a-40be-9347-81d7eb4f4e31: rpc.has_security_group_logging(os_id): False [ 1176.874043] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.874204] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.874286] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.874524] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.913403] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.913686] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.913845] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.913919] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.914138] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.914225] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.914461] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.914595] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.914668] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.914845] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.914913] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.915126] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.915232] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.915276] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.915412] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.915489] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.915574] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 is going to be updated. [ 1176.989211] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.024466] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.024663] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.024663] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.024849] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.024995] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.041359] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 in Status: IN_PROGRESS for 2s [ 1177.286942] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d: rpc.has_security_group_logging(os_id): False [ 1177.310007] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.310534] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.310534] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.310534] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.310745] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.311084] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.311084] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.311084] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.311084] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.311311] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.311357] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.311418] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.311483] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.311620] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.311699] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.311894] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.312061] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.312140] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.312312] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.312375] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.312453] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d is going to be updated. [ 1177.380026] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.380223] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.380305] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.380533] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.380689] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.394097] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: IN_PROGRESS for 2s [ 1177.492190] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.492406] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.492563] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.492791] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.492917] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.493080] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc is going to be updated. [ 1177.538937] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.539196] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.539196] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.539350] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.539493] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.549028] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: IN_PROGRESS for 2s [ 1178.844314] env[69506]: INFO networking_nsxv3.common.synchronization [req-b3e4888f-5295-459e-97c1-9f9906e72319 req-082f1d37-7973-40f9-ba1f-bf7fd4abfd08 tempest-ServerActionsTestJSON-78405165 tempest-ServerActionsTestJSON-78405165-project-member] Enqueued Resource ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 with Priority: HIGHEST for action security_group_members [ 1178.845125] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 with Priority: HIGHEST for action security_group_members [ 1178.845474] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.845631] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.845715] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.845991] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.846213] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.846329] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.846418] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.846631] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.846739] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.846857] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96b2c90a-a7a0-4dcb-8212-5e459d8d4793',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.053379] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 in Status: SUCCESS [ 1179.053593] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.349299] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.349464] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.349546] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.349836] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.349979] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.350280] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.350553] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.350666] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.350861] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.350979] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.351120] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 is going to be updated. [ 1179.378741] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.378911] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.378950] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.379187] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.379338] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.387661] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 in Status: IN_PROGRESS for 2s [ 1179.411473] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: SUCCESS [ 1179.411652] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.558446] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: SUCCESS [ 1179.558722] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.558932] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.559245] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.559453] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.559567] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.559666] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.559786] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.559871] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.559955] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.560078] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.062416] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.062809] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.062809] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.062889] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.063038] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.063175] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.063221] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.063372] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.063460] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.063551] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.063704] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.063797] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.063858] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.064032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.064180] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.064272] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.064333] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.064472] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.064549] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.064616] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.064702] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.567456] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc: rpc.has_security_group_logging(os_id): False [ 1180.585196] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.585357] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.585400] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.585602] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.585691] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.585884] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.585984] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.586064] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.586220] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.586297] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.586495] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.586585] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.586645] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.586785] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.586849] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.587034] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.587130] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.587205] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.587347] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.587418] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.587504] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc is going to be updated. [ 1180.644364] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.644526] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.644649] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.645344] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.645344] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.672678] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: IN_PROGRESS for 2s [ 1181.398572] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 in Status: SUCCESS [ 1181.398908] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 deletion is rescheduled due to dependency. [ 1181.398908] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.687204] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: SUCCESS [ 1182.687572] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.845963] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1183.845963] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1184.885341] env[69506]: INFO networking_nsxv3.common.synchronization [req-b6db6b44-3a4a-481b-b3dd-21b1d416dbcf req-210724da-2bfe-43e7-8b3f-c983c36da97c tempest-AttachVolumeNegativeTest-402732870 tempest-AttachVolumeNegativeTest-402732870-project-member] Enqueued Resource ID: c29a3314-8167-42dc-9e04-3dc4cb967960 with Priority: HIGHEST for action security_group_members [ 1184.886936] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c29a3314-8167-42dc-9e04-3dc4cb967960 with Priority: HIGHEST for action security_group_members [ 1184.886936] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-c29a3314-8167-42dc-9e04-3dc4cb967960 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.886936] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c29a3314-8167-42dc-9e04-3dc4cb967960" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.886936] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c29a3314-8167-42dc-9e04-3dc4cb967960" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.887352] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c29a3314-8167-42dc-9e04-3dc4cb967960" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.887352] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.887352] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.887528] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.887580] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.887761] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.887761] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c29a3314-8167-42dc-9e04-3dc4cb967960',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.283009] env[69506]: INFO networking_nsxv3.common.synchronization [req-53ba9489-9a53-46df-9a87-b36e1e1b5d9a req-d8b4f03e-03e0-4733-b6cd-c82165288078 tempest-DeleteServersTestJSON-1880805458 tempest-DeleteServersTestJSON-1880805458-project-member] Enqueued Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_members [ 1185.283633] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_members [ 1185.283973] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.283973] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.284123] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.284265] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.284431] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.284533] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.284590] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.284770] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.284849] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.284901] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.392250] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.392250] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.392250] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.392453] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.392570] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.392742] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.394038] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.394038] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.394038] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.394038] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.394038] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c29a3314-8167-42dc-9e04-3dc4cb967960 is going to be updated. [ 1185.419435] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.419587] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.419654] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.419865] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.420015] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.428118] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c29a3314-8167-42dc-9e04-3dc4cb967960 in Status: IN_PROGRESS for 2s [ 1185.786835] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.786835] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.786942] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.787819] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.787819] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.787819] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.787819] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.787819] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.787819] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.787819] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.788349] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d is going to be updated. [ 1185.812569] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.812747] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.812812] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.812992] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.813142] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.823021] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: IN_PROGRESS for 2s [ 1187.245176] env[69506]: INFO networking_nsxv3.common.synchronization [req-2d40a707-502c-46b6-a406-0cefb9b0b01d req-dc9a28ba-9416-4af0-91b5-9d19c56d11e1 tempest-ServersTestJSON-1801092994 tempest-ServersTestJSON-1801092994-project-member] Enqueued Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 1187.246264] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 1187.246264] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.246264] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.246264] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.246471] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.246542] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.246590] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.246638] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.246830] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.246945] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.246945] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.438368] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c29a3314-8167-42dc-9e04-3dc4cb967960 in Status: SUCCESS [ 1187.438516] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c29a3314-8167-42dc-9e04-3dc4cb967960 deletion is rescheduled due to dependency. [ 1187.438624] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c29a3314-8167-42dc-9e04-3dc4cb967960" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.749338] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.831181] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: SUCCESS [ 1187.831355] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d deletion is rescheduled due to dependency. [ 1187.831446] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.251421] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.362160] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-868 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.362366] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-868" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.362570] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-868" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.362902] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-868" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.363254] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.363548] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.363723] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.363985] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.364196] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.364467] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1188.364640] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1188.364766] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1188.364905] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1188.365067] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1188.365231] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1188.365397] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1188.383886] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1188.384132] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1188.384304] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1188.384597] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-868" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.384948] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-1287a7a9-2d9b-4056-a099-bfaf1bbe9a67 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.385184] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-1287a7a9-2d9b-4056-a099-bfaf1bbe9a67" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.385347] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-1287a7a9-2d9b-4056-a099-bfaf1bbe9a67" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.385632] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-1287a7a9-2d9b-4056-a099-bfaf1bbe9a67" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.385809] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1287a7a9-2d9b-4056-a099-bfaf1bbe9a67',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.753952] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.754156] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.754156] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.754379] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.754470] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.754573] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc is going to be updated. [ 1188.786589] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.786738] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.786807] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.787016] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.787164] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.795713] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: IN_PROGRESS for 2s [ 1188.888425] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.888425] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.888638] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.888851] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.889021] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.889477] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.889576] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.889689] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.889981] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.890176] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.890550] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.890688] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.890813] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.891040] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.891185] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.891333] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 1287a7a9-2d9b-4056-a099-bfaf1bbe9a67 is going to be updated. [ 1188.911801] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.911801] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.911958] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.912221] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.912411] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.912632] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-1287a7a9-2d9b-4056-a099-bfaf1bbe9a67" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.536995] env[69506]: INFO networking_nsxv3.common.synchronization [req-ba42fbda-84ea-42fe-b63e-4d4b48cf9c49 req-93871f70-7c27-4197-adfc-2309dedadc1c tempest-ServerActionsTestJSON-78405165 tempest-ServerActionsTestJSON-78405165-project-member] Enqueued Resource ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 with Priority: HIGHEST for action security_group_members [ 1189.537534] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 with Priority: HIGHEST for action security_group_members [ 1189.537835] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.537947] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.538036] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.538225] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.538356] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.538464] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.538524] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.538663] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.538751] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.538883] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96b2c90a-a7a0-4dcb-8212-5e459d8d4793',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.608587] env[69506]: INFO networking_nsxv3.common.synchronization [req-0cb557ba-3334-43e3-b79d-8438fdee9783 req-999fcf00-464f-4fe4-82d6-64037117c868 service nova] Enqueued Resource ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 with Priority: HIGHEST for action security_group_rules [ 1189.608723] env[69506]: INFO networking_nsxv3.common.synchronization [req-0cb557ba-3334-43e3-b79d-8438fdee9783 req-999fcf00-464f-4fe4-82d6-64037117c868 service nova] Enqueued Resource ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 with Priority: HIGHEST for action security_group_members [ 1189.608877] env[69506]: INFO networking_nsxv3.common.synchronization [req-0cb557ba-3334-43e3-b79d-8438fdee9783 req-999fcf00-464f-4fe4-82d6-64037117c868 service nova] Enqueued Resource ID: 1287a7a9-2d9b-4056-a099-bfaf1bbe9a67 with Priority: HIGHEST for action port [ 1189.609064] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 with Priority: HIGHEST for action security_group_rules [ 1189.609198] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 with Priority: HIGHEST for action security_group_members [ 1189.609295] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1287a7a9-2d9b-4056-a099-bfaf1bbe9a67 with Priority: HIGHEST for action port [ 1189.609824] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f946d66-543a-40be-9347-81d7eb4f4e31 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.609949] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.610075] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.610367] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.610462] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.611469] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f946d66-543a-40be-9347-81d7eb4f4e31 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.611469] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.611469] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.611723] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.611819] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.611899] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.611899] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.612078] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.612159] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.612261] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.613092] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-1287a7a9-2d9b-4056-a099-bfaf1bbe9a67 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.613376] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1287a7a9-2d9b-4056-a099-bfaf1bbe9a67" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.613376] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1287a7a9-2d9b-4056-a099-bfaf1bbe9a67" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.613376] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1287a7a9-2d9b-4056-a099-bfaf1bbe9a67" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.613462] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1287a7a9-2d9b-4056-a099-bfaf1bbe9a67',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.891226] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-656 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.891505] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-656" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.891620] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-656" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.891909] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-656" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.892261] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.892479] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.892639] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.892908] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.893092] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.893358] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1189.893510] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1189.893657] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1189.893810] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1189.893947] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1189.894108] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1189.894278] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1189.912361] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1189.912549] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1189.912755] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1189.913016] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-656" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.913433] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-dc6723b1-9067-405c-abcf-924a3417ff02 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.913743] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-dc6723b1-9067-405c-abcf-924a3417ff02" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.913964] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-dc6723b1-9067-405c-abcf-924a3417ff02" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.914333] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-dc6723b1-9067-405c-abcf-924a3417ff02" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.914597] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc6723b1-9067-405c-abcf-924a3417ff02',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.042071] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.042327] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.042439] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.042711] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.042851] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.043125] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.043267] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.043382] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.043595] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.043722] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.044741] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 is going to be updated. [ 1190.074166] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.074313] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.074379] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.074579] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.074730] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.083504] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 in Status: IN_PROGRESS for 2s [ 1190.115051] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f946d66-543a-40be-9347-81d7eb4f4e31 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.115190] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.116527] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.117700] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1287a7a9-2d9b-4056-a099-bfaf1bbe9a67 with status ACTIVE [ 1190.117700] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.117858] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.117858] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.118451] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.118451] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.118451] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.118451] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.118451] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.118717] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.118717] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.118822] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.118930] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.118982] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.119106] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.119192] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.119289] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1287a7a9-2d9b-4056-a099-bfaf1bbe9a67 is going to be updated. [ 1190.140941] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.141103] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.141147] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.141326] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.141459] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.141613] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1287a7a9-2d9b-4056-a099-bfaf1bbe9a67" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.416830] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.417081] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.417240] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.417522] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.417682] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.417845] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port dc6723b1-9067-405c-abcf-924a3417ff02 not found, creating... [ 1190.418128] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.418290] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.418414] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.418638] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.418784] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.419075] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.419237] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.419362] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.419575] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.419715] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.419857] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: dc6723b1-9067-405c-abcf-924a3417ff02 is going to be created. [ 1190.443375] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.443566] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.443706] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.443947] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.444201] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.444423] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-dc6723b1-9067-405c-abcf-924a3417ff02" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.621706] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.805904] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: SUCCESS [ 1190.806143] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.124361] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.124522] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.124643] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.128018] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.128018] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.128018] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 is going to be updated. [ 1191.160501] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.160639] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.160639] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.161319] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.161319] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.184180] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 in Status: IN_PROGRESS for 2s [ 1191.259151] env[69506]: INFO networking_nsxv3.common.synchronization [req-ba42fbda-84ea-42fe-b63e-4d4b48cf9c49 req-f0582d8e-91c8-4a3d-89e7-125850e96de5 service nova] Enqueued Resource ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 with Priority: HIGHEST for action security_group_rules [ 1191.259338] env[69506]: INFO networking_nsxv3.common.synchronization [req-ba42fbda-84ea-42fe-b63e-4d4b48cf9c49 req-f0582d8e-91c8-4a3d-89e7-125850e96de5 service nova] Enqueued Resource ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 with Priority: HIGHEST for action security_group_members [ 1191.259485] env[69506]: INFO networking_nsxv3.common.synchronization [req-ba42fbda-84ea-42fe-b63e-4d4b48cf9c49 req-f0582d8e-91c8-4a3d-89e7-125850e96de5 service nova] Enqueued Resource ID: dc6723b1-9067-405c-abcf-924a3417ff02 with Priority: HIGHEST for action port [ 1191.259973] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 with Priority: HIGHEST for action security_group_rules [ 1191.260144] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 with Priority: HIGHEST for action security_group_members [ 1191.260226] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc6723b1-9067-405c-abcf-924a3417ff02 with Priority: HIGHEST for action port [ 1191.260494] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.260613] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.260679] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.260872] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.260943] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('96b2c90a-a7a0-4dcb-8212-5e459d8d4793',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.262270] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.262270] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.262270] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc6723b1-9067-405c-abcf-924a3417ff02 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.262270] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc6723b1-9067-405c-abcf-924a3417ff02" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.262517] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc6723b1-9067-405c-abcf-924a3417ff02" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.262587] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc6723b1-9067-405c-abcf-924a3417ff02" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.262858] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc6723b1-9067-405c-abcf-924a3417ff02',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.684452] env[69506]: INFO networking_nsxv3.common.synchronization [None req-c338c14e-07cb-4f56-9ddc-5e1eb08afa19 tempest-AttachVolumeNegativeTest-402732870 tempest-AttachVolumeNegativeTest-402732870-project-member] Enqueued Resource ID: d91620e4-b545-4104-a2d6-4f8e42eac0c0 with Priority: HIGHEST for action security_group_rules [ 1191.684968] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d91620e4-b545-4104-a2d6-4f8e42eac0c0 with Priority: HIGHEST for action security_group_rules [ 1191.685287] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d91620e4-b545-4104-a2d6-4f8e42eac0c0 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.685410] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d91620e4-b545-4104-a2d6-4f8e42eac0c0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.685479] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d91620e4-b545-4104-a2d6-4f8e42eac0c0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.685731] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d91620e4-b545-4104-a2d6-4f8e42eac0c0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.685815] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d91620e4-b545-4104-a2d6-4f8e42eac0c0',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.765147] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.765312] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.765456] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dc6723b1-9067-405c-abcf-924a3417ff02 with status ACTIVE [ 1191.765627] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.765731] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.765795] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.766049] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.766134] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.766277] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.766375] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.766438] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.766589] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.766678] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.766878] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.766972] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.768571] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.768822] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.768917] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.769030] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dc6723b1-9067-405c-abcf-924a3417ff02 is going to be updated. [ 1191.790592] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.790592] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.790592] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.790592] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.790592] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.790592] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc6723b1-9067-405c-abcf-924a3417ff02" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.828971] env[69506]: INFO networking_nsxv3.common.synchronization [None req-5cb9ba85-7109-446a-83c3-89259f297013 tempest-AttachVolumeNegativeTest-402732870 tempest-AttachVolumeNegativeTest-402732870-project-member] Enqueued Resource ID: d91620e4-b545-4104-a2d6-4f8e42eac0c0 with Priority: HIGHEST for action security_group_rules [ 1191.829527] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d91620e4-b545-4104-a2d6-4f8e42eac0c0 with Priority: HIGHEST for action security_group_rules [ 1191.829832] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d91620e4-b545-4104-a2d6-4f8e42eac0c0 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.829979] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d91620e4-b545-4104-a2d6-4f8e42eac0c0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.954118] env[69506]: INFO networking_nsxv3.common.synchronization [req-caff0c13-3c4e-4d6e-a4da-8fa74dfc9c49 req-79f3dcf7-cbbb-4e4e-98eb-a7cb96b56d94 tempest-ServersNegativeTestJSON-1250642852 tempest-ServersNegativeTestJSON-1250642852-project-member] Enqueued Resource ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca with Priority: HIGHEST for action security_group_members [ 1191.954627] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca with Priority: HIGHEST for action security_group_members [ 1191.954927] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.955060] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.955128] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.955331] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.955481] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.955571] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.955924] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.955924] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.955924] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.955924] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0461c6a-1d2b-401e-b59f-af6eda84b6ca',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.093305] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 in Status: SUCCESS [ 1192.093494] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 deletion is rescheduled due to dependency. [ 1192.093609] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.093786] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.093985] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.094234] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.094307] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.094356] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.094517] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.094604] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.094702] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96b2c90a-a7a0-4dcb-8212-5e459d8d4793',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.208312] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.208312] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.208312] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.208312] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.208312] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.208312] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d91620e4-b545-4104-a2d6-4f8e42eac0c0 already deleted. [ 1192.208312] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d91620e4-b545-4104-a2d6-4f8e42eac0c0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.208312] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d91620e4-b545-4104-a2d6-4f8e42eac0c0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.208312] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d91620e4-b545-4104-a2d6-4f8e42eac0c0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.208312] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d91620e4-b545-4104-a2d6-4f8e42eac0c0',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.458699] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.458853] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.458908] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.459151] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.459240] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.459444] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.459544] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.459619] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.459819] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.459910] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.460009] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca is going to be updated. [ 1192.486442] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.486626] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.486723] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.486959] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.487113] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.494799] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca in Status: IN_PROGRESS for 2s [ 1192.597453] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('96b2c90a-a7a0-4dcb-8212-5e459d8d4793',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.728410] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.728726] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.728726] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.728795] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.728826] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.729499] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d91620e4-b545-4104-a2d6-4f8e42eac0c0 already deleted. [ 1192.729499] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d91620e4-b545-4104-a2d6-4f8e42eac0c0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.100263] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('96b2c90a-a7a0-4dcb-8212-5e459d8d4793',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.203910] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 in Status: SUCCESS [ 1193.204163] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.204336] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.204601] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.204798] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.204917] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.204983] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.205150] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.205238] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.205320] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.205413] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.602795] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.602950] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.603037] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.603266] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.603356] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.603456] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 is going to be updated. [ 1193.653163] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.653311] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.653354] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.653557] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.653698] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.661915] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 in Status: IN_PROGRESS for 2s [ 1193.707487] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f946d66-543a-40be-9347-81d7eb4f4e31 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.707687] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.707731] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.707937] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.708127] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.708233] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.708298] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.708452] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.708539] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.708628] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.708775] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f946d66-543a-40be-9347-81d7eb4f4e31 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.708864] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.708924] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.709078] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.709213] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.709303] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.709364] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.709497] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.709570] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.709650] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.709736] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.211719] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3f946d66-543a-40be-9347-81d7eb4f4e31: rpc.has_security_group_logging(os_id): False [ 1194.229874] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.229874] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.229874] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.229874] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.229874] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.230142] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.230142] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.230241] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.230364] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.230419] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.230610] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.230704] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.230762] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.230897] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.230969] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.231161] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.231245] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.231301] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.232037] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.232037] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.232037] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 is going to be updated. [ 1194.287845] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.288023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.288076] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.288281] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.288422] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.299748] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 in Status: IN_PROGRESS for 2s [ 1194.504428] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca in Status: SUCCESS [ 1194.504650] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca deletion is rescheduled due to dependency. [ 1194.504768] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.681832] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 in Status: SUCCESS [ 1195.682258] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.682258] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.682469] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.682665] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.682782] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.682847] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.682999] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.683092] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.683180] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.683280] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('96b2c90a-a7a0-4dcb-8212-5e459d8d4793',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.185419] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('96b2c90a-a7a0-4dcb-8212-5e459d8d4793',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.312656] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 in Status: SUCCESS [ 1196.312887] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.687431] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 96b2c90a-a7a0-4dcb-8212-5e459d8d4793: rpc.has_security_group_logging(os_id): False [ 1196.705478] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.705620] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.705695] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.705945] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.706050] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.706304] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.706407] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.706472] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.706703] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.706786] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.706889] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 is going to be updated. [ 1196.760676] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.761221] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.761221] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.761221] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.761395] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.772915] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 in Status: IN_PROGRESS for 2s [ 1196.934760] env[69506]: INFO networking_nsxv3.common.synchronization [req-1d9f8ce1-8a33-4aca-8dde-1ab490b68ddf req-7537ea31-fe62-49b5-a186-1e3428a8c863 tempest-ServersTestJSON-1801092994 tempest-ServersTestJSON-1801092994-project-member] Enqueued Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 1196.935309] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGHEST for action security_group_members [ 1196.935637] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.935768] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.935829] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.936622] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.936962] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.937118] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.937192] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.937432] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.937609] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.937609] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.440880] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.440880] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.440880] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.441126] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.441126] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.441219] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.441318] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.441379] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.441534] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.441616] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.441694] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc is going to be updated. [ 1197.468165] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.468366] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.468366] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.468584] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.468727] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.477488] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: IN_PROGRESS for 2s [ 1198.191733] env[69506]: INFO networking_nsxv3.common.synchronization [req-814179c7-29d6-4aae-90e9-dd1d1ec5dbd1 req-04369c56-3c4f-48b2-be87-f0077aedd69c tempest-DeleteServersTestJSON-1880805458 tempest-DeleteServersTestJSON-1880805458-project-member] Enqueued Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_members [ 1198.192408] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_members [ 1198.192602] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.192724] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.192801] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.192984] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.193147] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.193264] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.193367] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.193453] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.193520] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.193614] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.515075] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-628 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.515299] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-628" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.515430] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-628" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.515701] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-628" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.516037] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.516214] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.516337] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.516556] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.516706] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.516934] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1198.517069] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1198.517173] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1198.517286] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1198.517437] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1198.517673] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1198.517673] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1198.535870] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1198.536043] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1198.536631] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1198.536631] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-628" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.536631] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-f460d568-00d9-42bc-9626-ba1193caf129 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.536844] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-f460d568-00d9-42bc-9626-ba1193caf129" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.536923] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-f460d568-00d9-42bc-9626-ba1193caf129" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.537251] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-f460d568-00d9-42bc-9626-ba1193caf129" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.537393] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f460d568-00d9-42bc-9626-ba1193caf129',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.695429] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.696067] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.696067] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.696067] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.696067] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.696269] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.696269] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.696354] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.696438] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.696516] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.696605] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d is going to be updated. [ 1198.726158] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.726330] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.726408] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.726626] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.726764] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.735974] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: IN_PROGRESS for 2s [ 1198.785696] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 in Status: SUCCESS [ 1198.785856] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.039704] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.039906] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.040054] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.040379] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.040542] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.040705] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port f460d568-00d9-42bc-9626-ba1193caf129 not found, creating... [ 1199.040962] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.041148] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.041273] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.041501] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.041644] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.041926] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.042098] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.042219] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.042496] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.042643] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.042787] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: f460d568-00d9-42bc-9626-ba1193caf129 is going to be created. [ 1199.061926] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.062233] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.062520] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.062839] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.063165] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.063485] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-f460d568-00d9-42bc-9626-ba1193caf129" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.486135] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc in Status: SUCCESS [ 1199.486511] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc deletion is rescheduled due to dependency. [ 1199.486511] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.764298] env[69506]: INFO networking_nsxv3.common.synchronization [req-814179c7-29d6-4aae-90e9-dd1d1ec5dbd1 req-89b0447a-9c4d-48c9-ae3d-2d253aefded1 service nova] Enqueued Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_rules [ 1199.764485] env[69506]: INFO networking_nsxv3.common.synchronization [req-814179c7-29d6-4aae-90e9-dd1d1ec5dbd1 req-89b0447a-9c4d-48c9-ae3d-2d253aefded1 service nova] Enqueued Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_members [ 1199.764628] env[69506]: INFO networking_nsxv3.common.synchronization [req-814179c7-29d6-4aae-90e9-dd1d1ec5dbd1 req-89b0447a-9c4d-48c9-ae3d-2d253aefded1 service nova] Enqueued Resource ID: f460d568-00d9-42bc-9626-ba1193caf129 with Priority: HIGHEST for action port [ 1199.764857] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_rules [ 1199.764981] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_members [ 1199.765089] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f460d568-00d9-42bc-9626-ba1193caf129 with Priority: HIGHEST for action port [ 1199.765627] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.765752] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.765815] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.766025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.766112] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.767477] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.767578] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.767768] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-f460d568-00d9-42bc-9626-ba1193caf129 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.767929] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f460d568-00d9-42bc-9626-ba1193caf129" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.767929] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f460d568-00d9-42bc-9626-ba1193caf129" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.768337] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f460d568-00d9-42bc-9626-ba1193caf129" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.768337] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f460d568-00d9-42bc-9626-ba1193caf129',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.269404] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.269567] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.269740] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f460d568-00d9-42bc-9626-ba1193caf129 with status ACTIVE [ 1200.269916] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.270031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.270115] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.270379] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.270458] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.270633] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.270731] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.270826] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.270938] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.271026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.271209] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.271304] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.271358] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.271517] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.271593] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.271679] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f460d568-00d9-42bc-9626-ba1193caf129 is going to be updated. [ 1200.289961] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.290117] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.290169] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.290357] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.290498] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.290659] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f460d568-00d9-42bc-9626-ba1193caf129" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.376147] env[69506]: INFO networking_nsxv3.common.synchronization [req-6144328f-8e4c-43bf-ac56-9ce81bac6bc5 req-fba2240d-2177-4500-bb53-033fc06f9126 tempest-AttachVolumeNegativeTest-402732870 tempest-AttachVolumeNegativeTest-402732870-project-member] Enqueued Resource ID: d91620e4-b545-4104-a2d6-4f8e42eac0c0 with Priority: HIGHEST for action security_group_members [ 1200.376703] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d91620e4-b545-4104-a2d6-4f8e42eac0c0 with Priority: HIGHEST for action security_group_members [ 1200.377041] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d91620e4-b545-4104-a2d6-4f8e42eac0c0 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.377170] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d91620e4-b545-4104-a2d6-4f8e42eac0c0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.377243] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d91620e4-b545-4104-a2d6-4f8e42eac0c0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.377527] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d91620e4-b545-4104-a2d6-4f8e42eac0c0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.377713] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.377816] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.377886] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.378068] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.378156] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.378254] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d91620e4-b545-4104-a2d6-4f8e42eac0c0',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.643206] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-477 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.643565] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-477" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.643565] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-477" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.643878] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-477" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.644369] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.644593] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.644754] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.645069] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.645263] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.645611] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1200.645672] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1200.645791] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1200.645934] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1200.646080] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1200.646219] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1200.646390] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1200.664503] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1200.664709] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1200.664922] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1200.665158] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-477" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.665496] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-b336f37a-5e2d-4007-a25b-0aa95b17d232 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.665676] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-b336f37a-5e2d-4007-a25b-0aa95b17d232" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.665801] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-b336f37a-5e2d-4007-a25b-0aa95b17d232" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.666153] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-b336f37a-5e2d-4007-a25b-0aa95b17d232" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.666375] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b336f37a-5e2d-4007-a25b-0aa95b17d232',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.744801] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: SUCCESS [ 1200.745057] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d deletion is rescheduled due to dependency. [ 1200.745135] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.745292] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.745511] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.745693] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.745809] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.745876] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.746031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.746115] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.746210] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.880205] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.880360] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.880445] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.880671] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.880771] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.880957] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.881084] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.881149] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.881296] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.881373] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.881460] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d91620e4-b545-4104-a2d6-4f8e42eac0c0 already deleted. [ 1200.881541] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d91620e4-b545-4104-a2d6-4f8e42eac0c0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.168955] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.169217] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.169353] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.169639] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.169800] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.169962] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port b336f37a-5e2d-4007-a25b-0aa95b17d232 not found, creating... [ 1201.170279] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.170396] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.170515] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.170745] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.170893] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.171196] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.171358] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.171482] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.171698] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.171840] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.171987] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: b336f37a-5e2d-4007-a25b-0aa95b17d232 is going to be created. [ 1201.190732] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.190906] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.191047] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.191287] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.191507] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.191724] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-b336f37a-5e2d-4007-a25b-0aa95b17d232" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.248404] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.751269] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.916769] env[69506]: INFO networking_nsxv3.common.synchronization [req-6144328f-8e4c-43bf-ac56-9ce81bac6bc5 req-c8d04a5e-29f8-4f51-a222-f4e605283a13 service nova] Enqueued Resource ID: d91620e4-b545-4104-a2d6-4f8e42eac0c0 with Priority: HIGHEST for action security_group_rules [ 1201.916825] env[69506]: INFO networking_nsxv3.common.synchronization [req-6144328f-8e4c-43bf-ac56-9ce81bac6bc5 req-c8d04a5e-29f8-4f51-a222-f4e605283a13 service nova] Enqueued Resource ID: d91620e4-b545-4104-a2d6-4f8e42eac0c0 with Priority: HIGHEST for action security_group_members [ 1201.916967] env[69506]: INFO networking_nsxv3.common.synchronization [req-6144328f-8e4c-43bf-ac56-9ce81bac6bc5 req-c8d04a5e-29f8-4f51-a222-f4e605283a13 service nova] Enqueued Resource ID: b336f37a-5e2d-4007-a25b-0aa95b17d232 with Priority: HIGHEST for action port [ 1201.917457] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d91620e4-b545-4104-a2d6-4f8e42eac0c0 with Priority: HIGHEST for action security_group_rules [ 1201.917593] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d91620e4-b545-4104-a2d6-4f8e42eac0c0 with Priority: HIGHEST for action security_group_members [ 1201.917689] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b336f37a-5e2d-4007-a25b-0aa95b17d232 with Priority: HIGHEST for action port [ 1201.917964] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d91620e4-b545-4104-a2d6-4f8e42eac0c0 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.918236] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d91620e4-b545-4104-a2d6-4f8e42eac0c0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.918304] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d91620e4-b545-4104-a2d6-4f8e42eac0c0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.918511] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d91620e4-b545-4104-a2d6-4f8e42eac0c0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.918596] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d91620e4-b545-4104-a2d6-4f8e42eac0c0',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.921849] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d91620e4-b545-4104-a2d6-4f8e42eac0c0 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.921986] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d91620e4-b545-4104-a2d6-4f8e42eac0c0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.922067] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d91620e4-b545-4104-a2d6-4f8e42eac0c0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.922317] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d91620e4-b545-4104-a2d6-4f8e42eac0c0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.922592] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.922725] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.922812] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.922979] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.923227] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.923227] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d91620e4-b545-4104-a2d6-4f8e42eac0c0',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.924430] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-b336f37a-5e2d-4007-a25b-0aa95b17d232 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.924430] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b336f37a-5e2d-4007-a25b-0aa95b17d232" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.924630] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b336f37a-5e2d-4007-a25b-0aa95b17d232" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.924805] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b336f37a-5e2d-4007-a25b-0aa95b17d232" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.924883] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b336f37a-5e2d-4007-a25b-0aa95b17d232',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.254372] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.254609] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.254609] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.254818] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.254888] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.254994] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d is going to be updated. [ 1202.283249] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.283482] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.283482] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.284025] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.284180] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.294999] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: IN_PROGRESS for 2s [ 1202.422126] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d91620e4-b545-4104-a2d6-4f8e42eac0c0 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.422409] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d91620e4-b545-4104-a2d6-4f8e42eac0c0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.424896] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d91620e4-b545-4104-a2d6-4f8e42eac0c0',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.426154] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b336f37a-5e2d-4007-a25b-0aa95b17d232 with status ACTIVE [ 1202.426521] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.426678] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.426783] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.427078] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.427213] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.427468] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.427633] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.427730] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.427954] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.432568] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.432568] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.432746] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.432746] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.432981] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.433115] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.433255] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b336f37a-5e2d-4007-a25b-0aa95b17d232 is going to be updated. [ 1202.464836] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.465072] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.465072] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.465262] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.465420] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.465598] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b336f37a-5e2d-4007-a25b-0aa95b17d232" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.936149] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d91620e4-b545-4104-a2d6-4f8e42eac0c0',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.439345] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.439696] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.439696] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.439926] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.440027] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.440136] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d91620e4-b545-4104-a2d6-4f8e42eac0c0 is going to be created. [ 1203.462086] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.462221] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.463027] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.463027] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.463027] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.471680] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d91620e4-b545-4104-a2d6-4f8e42eac0c0 in Status: UNINITIALIZED for 2s [ 1204.306290] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: SUCCESS [ 1204.306290] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.306290] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.306290] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.306290] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.306290] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.306290] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.306290] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.306290] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.306290] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.306290] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.528393] env[69506]: INFO networking_nsxv3.common.synchronization [req-7055f004-ad15-41bc-bbc1-f2b38428b357 req-c982e91c-54ea-4f13-b8f1-8d6432ee5c3d tempest-AttachInterfacesTestJSON-2055467997 tempest-AttachInterfacesTestJSON-2055467997-project-member] Enqueued Resource ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 with Priority: HIGHEST for action security_group_members [ 1204.528393] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 with Priority: HIGHEST for action security_group_members [ 1204.528539] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.528539] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.528663] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.528819] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.528967] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.530047] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.530047] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.530285] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.530333] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.530699] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d9ed455-9c3f-46b7-9453-8a5f9cfb0580',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.810231] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.810231] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.810231] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.810366] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.810600] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.810600] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.810727] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.810799] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.810869] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.810958] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.811124] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.811216] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.811277] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.811417] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.811555] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.811643] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.811705] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.811840] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.811932] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.812028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.812367] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.032968] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d9ed455-9c3f-46b7-9453-8a5f9cfb0580',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.314011] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d: rpc.has_security_group_logging(os_id): False [ 1205.333682] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.333867] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.333933] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.334308] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.334419] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.334657] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.334763] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.334829] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.334990] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.335086] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.335275] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.335896] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.335896] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.335896] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.335896] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.335896] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.335896] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.336185] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.336520] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.336658] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.336798] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d is going to be updated. [ 1205.395635] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.395635] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.395635] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.395635] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.395635] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.406655] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: IN_PROGRESS for 2s [ 1205.481812] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d91620e4-b545-4104-a2d6-4f8e42eac0c0 in Status: SUCCESS [ 1205.482073] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d91620e4-b545-4104-a2d6-4f8e42eac0c0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.482252] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d91620e4-b545-4104-a2d6-4f8e42eac0c0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.482586] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d91620e4-b545-4104-a2d6-4f8e42eac0c0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.482829] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.482985] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.483098] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.483286] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.483407] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.483526] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d91620e4-b545-4104-a2d6-4f8e42eac0c0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.483647] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d91620e4-b545-4104-a2d6-4f8e42eac0c0',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.535265] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d9ed455-9c3f-46b7-9453-8a5f9cfb0580',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.987710] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d91620e4-b545-4104-a2d6-4f8e42eac0c0',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.037561] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.037766] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.037766] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.037964] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.038080] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.038191] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 is going to be updated. [ 1206.065528] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.065773] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.065833] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.066161] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.066405] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.078125] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 in Status: IN_PROGRESS for 2s [ 1206.171010] env[69506]: INFO networking_nsxv3.common.synchronization [None req-52acdcdb-13fc-448c-a825-0c187163b617 None None] Enqueued Resource ID: 03a5208a-717f-45ba-99f0-d5b2b218f99a with Priority: HIGHEST for action port [ 1206.171641] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03a5208a-717f-45ba-99f0-d5b2b218f99a with Priority: HIGHEST for action port [ 1206.171978] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-03a5208a-717f-45ba-99f0-d5b2b218f99a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.172117] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03a5208a-717f-45ba-99f0-d5b2b218f99a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.172186] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03a5208a-717f-45ba-99f0-d5b2b218f99a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.173381] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03a5208a-717f-45ba-99f0-d5b2b218f99a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.173381] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03a5208a-717f-45ba-99f0-d5b2b218f99a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.491325] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d91620e4-b545-4104-a2d6-4f8e42eac0c0: rpc.has_security_group_logging(os_id): False [ 1206.508198] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.508410] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.508410] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.508630] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.508768] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.508965] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.509119] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.509311] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.509311] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.509611] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.509611] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d91620e4-b545-4104-a2d6-4f8e42eac0c0 is going to be created. [ 1206.567157] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.567384] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.567491] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.567702] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.567899] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.577407] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d91620e4-b545-4104-a2d6-4f8e42eac0c0 in Status: IN_PROGRESS for 2s [ 1206.675448] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 03a5208a-717f-45ba-99f0-d5b2b218f99a [ 1206.676347] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.676347] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.676347] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.676347] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.676347] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.676347] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:03a5208a-717f-45ba-99f0-d5b2b218f99a already deleted. [ 1206.676347] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03a5208a-717f-45ba-99f0-d5b2b218f99a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.759171] env[69506]: INFO networking_nsxv3.common.synchronization [None req-1552aaf8-013c-4b31-bd0e-67f293b0f5e2 tempest-AttachVolumeTestJSON-1082346606 tempest-AttachVolumeTestJSON-1082346606-project-member] Enqueued Resource ID: 28204c48-8cc9-4a78-9ae1-cbf9a28e9016 with Priority: HIGHEST for action security_group_rules [ 1206.759902] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28204c48-8cc9-4a78-9ae1-cbf9a28e9016 with Priority: HIGHEST for action security_group_rules [ 1206.760059] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28204c48-8cc9-4a78-9ae1-cbf9a28e9016 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.760190] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.760257] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.760548] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.760638] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28204c48-8cc9-4a78-9ae1-cbf9a28e9016',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.840608] env[69506]: INFO networking_nsxv3.common.synchronization [None req-1ce70852-83b4-4591-b291-a0402cc8f621 tempest-AttachVolumeTestJSON-1082346606 tempest-AttachVolumeTestJSON-1082346606-project-member] Enqueued Resource ID: 28204c48-8cc9-4a78-9ae1-cbf9a28e9016 with Priority: HIGHEST for action security_group_rules [ 1206.841187] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28204c48-8cc9-4a78-9ae1-cbf9a28e9016 with Priority: HIGHEST for action security_group_rules [ 1206.841502] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28204c48-8cc9-4a78-9ae1-cbf9a28e9016 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.841610] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.280753] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.283387] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.283531] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.283712] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.283833] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.283938] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28204c48-8cc9-4a78-9ae1-cbf9a28e9016 already deleted. [ 1207.284035] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.284197] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.284365] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.284453] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28204c48-8cc9-4a78-9ae1-cbf9a28e9016',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.427938] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: SUCCESS [ 1207.429326] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.813654] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.813654] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.813654] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.813654] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.813654] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.813654] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28204c48-8cc9-4a78-9ae1-cbf9a28e9016 already deleted. [ 1207.813654] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.091718] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 in Status: SUCCESS [ 1208.091937] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.279597] env[69506]: INFO networking_nsxv3.common.synchronization [None req-802fb770-a6fd-4dc3-8632-90b48dbfbd4a None None] Enqueued Resource ID: 79bcec9b-cd25-4e69-a551-0cda8e351e78 with Priority: HIGHEST for action port [ 1208.280149] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79bcec9b-cd25-4e69-a551-0cda8e351e78 with Priority: HIGHEST for action port [ 1208.280499] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-79bcec9b-cd25-4e69-a551-0cda8e351e78 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.280630] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79bcec9b-cd25-4e69-a551-0cda8e351e78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.280715] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79bcec9b-cd25-4e69-a551-0cda8e351e78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.280997] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79bcec9b-cd25-4e69-a551-0cda8e351e78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.281876] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79bcec9b-cd25-4e69-a551-0cda8e351e78',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.589029] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d91620e4-b545-4104-a2d6-4f8e42eac0c0 in Status: SUCCESS [ 1208.589355] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d91620e4-b545-4104-a2d6-4f8e42eac0c0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.784255] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 79bcec9b-cd25-4e69-a551-0cda8e351e78 [ 1208.784482] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.784644] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.784727] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.785090] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.785217] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.785351] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:79bcec9b-cd25-4e69-a551-0cda8e351e78 already deleted. [ 1208.785842] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79bcec9b-cd25-4e69-a551-0cda8e351e78" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.896260] env[69506]: INFO networking_nsxv3.common.synchronization [req-00c04d5c-761f-4ceb-a232-e9afcd4e03d0 req-16d6c4de-c67a-4d43-a154-12a2e9d1db4f tempest-AttachInterfacesTestJSON-2055467997 tempest-AttachInterfacesTestJSON-2055467997-project-member] Enqueued Resource ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 with Priority: HIGHEST for action security_group_members [ 1211.896834] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 with Priority: HIGHEST for action security_group_members [ 1211.897304] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.897444] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.897516] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.897757] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.898088] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.898088] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.898216] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.898285] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.898390] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.898507] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d9ed455-9c3f-46b7-9453-8a5f9cfb0580',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.373149] env[69506]: INFO networking_nsxv3.common.synchronization [req-40f37caf-e84e-419b-a636-6fa720123d92 req-42c77d4c-38e2-4eb8-9fe5-6faab1527d82 tempest-AttachVolumeTestJSON-1082346606 tempest-AttachVolumeTestJSON-1082346606-project-member] Enqueued Resource ID: 28204c48-8cc9-4a78-9ae1-cbf9a28e9016 with Priority: HIGHEST for action security_group_members [ 1212.373149] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28204c48-8cc9-4a78-9ae1-cbf9a28e9016 with Priority: HIGHEST for action security_group_members [ 1212.373149] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-28204c48-8cc9-4a78-9ae1-cbf9a28e9016 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.373149] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.373149] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.373149] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.373149] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.373149] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.373787] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.374160] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.374370] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.374576] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28204c48-8cc9-4a78-9ae1-cbf9a28e9016',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.401746] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.405028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.405028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.405028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.405028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.405028] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.405028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.405028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.405028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.405028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.405028] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 is going to be updated. [ 1212.434633] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.435588] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.435588] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.435588] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.436490] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.444473] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 in Status: IN_PROGRESS for 2s [ 1212.563146] env[69506]: INFO networking_nsxv3.common.synchronization [req-c73cb49d-3901-4c3f-b7ff-09aef4a46d4e req-1829bd57-8629-4682-9efc-903a7bba67ff tempest-DeleteServersTestJSON-1880805458 tempest-DeleteServersTestJSON-1880805458-project-member] Enqueued Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_members [ 1212.563690] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_members [ 1212.564016] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.564203] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.564321] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.564609] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.564850] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.565011] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.565119] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.565343] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.565447] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.565603] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.636865] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-211 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.637090] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-211" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.637223] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-211" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.637588] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-211" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.637870] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.637973] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.638089] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.638319] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.638473] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.638747] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1212.638876] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1212.638994] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1212.639123] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1212.639240] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1212.639354] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1212.639492] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1212.659108] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1212.659276] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1212.659424] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1212.659613] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-211" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.659921] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-19847362-770e-44f5-aefa-45c7326c4f0e taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.660109] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-19847362-770e-44f5-aefa-45c7326c4f0e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.660235] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-19847362-770e-44f5-aefa-45c7326c4f0e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.660557] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-19847362-770e-44f5-aefa-45c7326c4f0e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.660705] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19847362-770e-44f5-aefa-45c7326c4f0e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.876894] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.877110] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.877190] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.877349] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.877441] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.877674] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.877781] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.877840] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.877990] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.878081] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.878169] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28204c48-8cc9-4a78-9ae1-cbf9a28e9016 already deleted. [ 1212.878250] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.068521] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.068521] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.068521] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.068972] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.068972] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.069043] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.069107] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.069214] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.069474] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.069598] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.069715] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d is going to be updated. [ 1213.095176] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.095316] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.095387] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.095585] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.095725] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.106940] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: IN_PROGRESS for 2s [ 1213.164696] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.164904] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.166032] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.166032] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.166032] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.166032] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 19847362-770e-44f5-aefa-45c7326c4f0e not found, creating... [ 1213.166032] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.166337] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.166337] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.166428] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.166576] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.167134] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.167134] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.167134] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.167362] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.167483] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.167727] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 19847362-770e-44f5-aefa-45c7326c4f0e is going to be created. [ 1213.197093] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.197334] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.197410] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.197661] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.197888] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.198132] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-19847362-770e-44f5-aefa-45c7326c4f0e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.867567] env[69506]: INFO networking_nsxv3.common.synchronization [req-40f37caf-e84e-419b-a636-6fa720123d92 req-9b98457f-bd64-4d3f-9e04-9fc285c3b6ba service nova] Enqueued Resource ID: 28204c48-8cc9-4a78-9ae1-cbf9a28e9016 with Priority: HIGHEST for action security_group_rules [ 1213.867758] env[69506]: INFO networking_nsxv3.common.synchronization [req-40f37caf-e84e-419b-a636-6fa720123d92 req-9b98457f-bd64-4d3f-9e04-9fc285c3b6ba service nova] Enqueued Resource ID: 28204c48-8cc9-4a78-9ae1-cbf9a28e9016 with Priority: HIGHEST for action security_group_members [ 1213.867924] env[69506]: INFO networking_nsxv3.common.synchronization [req-40f37caf-e84e-419b-a636-6fa720123d92 req-9b98457f-bd64-4d3f-9e04-9fc285c3b6ba service nova] Enqueued Resource ID: 19847362-770e-44f5-aefa-45c7326c4f0e with Priority: HIGHEST for action port [ 1213.868146] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28204c48-8cc9-4a78-9ae1-cbf9a28e9016 with Priority: HIGHEST for action security_group_rules [ 1213.868265] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28204c48-8cc9-4a78-9ae1-cbf9a28e9016 with Priority: HIGHEST for action security_group_members [ 1213.868361] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19847362-770e-44f5-aefa-45c7326c4f0e with Priority: HIGHEST for action port [ 1213.868889] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28204c48-8cc9-4a78-9ae1-cbf9a28e9016 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.869174] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.869276] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.869481] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.869564] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28204c48-8cc9-4a78-9ae1-cbf9a28e9016',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.870395] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-28204c48-8cc9-4a78-9ae1-cbf9a28e9016 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.870728] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.870728] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.870728] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.870912] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.870957] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.871015] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.871158] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.871244] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.871333] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28204c48-8cc9-4a78-9ae1-cbf9a28e9016',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.872188] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-19847362-770e-44f5-aefa-45c7326c4f0e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.872188] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19847362-770e-44f5-aefa-45c7326c4f0e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.872328] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19847362-770e-44f5-aefa-45c7326c4f0e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.872425] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19847362-770e-44f5-aefa-45c7326c4f0e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.872425] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19847362-770e-44f5-aefa-45c7326c4f0e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.377828] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-28204c48-8cc9-4a78-9ae1-cbf9a28e9016 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.378117] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.378183] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('28204c48-8cc9-4a78-9ae1-cbf9a28e9016',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.379085] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 19847362-770e-44f5-aefa-45c7326c4f0e with status ACTIVE [ 1214.379435] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.379435] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.379435] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.379645] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.379730] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.379898] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.379992] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.380057] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.380204] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.380279] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.380504] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.380638] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.380638] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.380798] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.380903] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.381040] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 19847362-770e-44f5-aefa-45c7326c4f0e is going to be updated. [ 1214.400435] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.400618] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.400717] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.400925] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.401084] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.401271] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19847362-770e-44f5-aefa-45c7326c4f0e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.455020] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 in Status: SUCCESS [ 1214.456115] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 deletion is rescheduled due to dependency. [ 1214.456115] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.883593] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('28204c48-8cc9-4a78-9ae1-cbf9a28e9016',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.116976] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: SUCCESS [ 1215.116976] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d deletion is rescheduled due to dependency. [ 1215.116976] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.386382] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.386583] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.386583] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.387163] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.387163] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.387310] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28204c48-8cc9-4a78-9ae1-cbf9a28e9016 is going to be created. [ 1215.408901] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.409286] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.409427] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.409723] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.409945] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.418968] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28204c48-8cc9-4a78-9ae1-cbf9a28e9016 in Status: UNINITIALIZED for 2s [ 1216.300635] env[69506]: INFO networking_nsxv3.common.synchronization [None req-cd5ff284-a2bd-4bff-86f1-cc7a9d40b153 tempest-AttachInterfacesTestJSON-2055467997 tempest-AttachInterfacesTestJSON-2055467997-project-member] Enqueued Resource ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 with Priority: HIGHEST for action security_group_members [ 1216.301364] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 with Priority: HIGHEST for action security_group_members [ 1216.301822] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f946d66-543a-40be-9347-81d7eb4f4e31 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.302051] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.302148] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.302402] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.302622] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.302758] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.302844] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.303051] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.303172] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.303298] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.805999] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.806338] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.806338] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.806533] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.806602] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.806811] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.807055] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.807055] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.807267] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.807367] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.807487] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 is going to be updated. [ 1216.832188] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.832341] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.832411] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.832668] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.832856] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.840892] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 in Status: IN_PROGRESS for 2s [ 1217.428909] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28204c48-8cc9-4a78-9ae1-cbf9a28e9016 in Status: SUCCESS [ 1217.429109] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.429286] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.429512] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.429711] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.429830] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.429896] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.430060] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.430150] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.430272] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.430371] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('28204c48-8cc9-4a78-9ae1-cbf9a28e9016',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.933272] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('28204c48-8cc9-4a78-9ae1-cbf9a28e9016',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.435665] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 28204c48-8cc9-4a78-9ae1-cbf9a28e9016: rpc.has_security_group_logging(os_id): False [ 1218.453903] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.454057] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.454127] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.454353] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.454443] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.454695] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.454792] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.454868] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.455083] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.455155] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.455324] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28204c48-8cc9-4a78-9ae1-cbf9a28e9016 is going to be created. [ 1218.515683] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.515683] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.515683] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.515935] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.516100] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.526441] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28204c48-8cc9-4a78-9ae1-cbf9a28e9016 in Status: IN_PROGRESS for 2s [ 1218.851040] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 in Status: SUCCESS [ 1218.851453] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 deletion is rescheduled due to dependency. [ 1218.851453] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.539248] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28204c48-8cc9-4a78-9ae1-cbf9a28e9016 in Status: SUCCESS [ 1220.539507] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.842091] env[69506]: INFO networking_nsxv3.common.synchronization [None req-4a660a05-b7ee-49eb-ae6f-25a36255a937 None None] Enqueued Resource ID: b6b85158-4da0-471b-8fc2-009f956a924a with Priority: HIGHEST for action port [ 1220.842859] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6b85158-4da0-471b-8fc2-009f956a924a with Priority: HIGHEST for action port [ 1220.844059] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6b85158-4da0-471b-8fc2-009f956a924a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.844059] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6b85158-4da0-471b-8fc2-009f956a924a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.844059] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6b85158-4da0-471b-8fc2-009f956a924a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.844321] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6b85158-4da0-471b-8fc2-009f956a924a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.844566] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6b85158-4da0-471b-8fc2-009f956a924a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.347101] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b6b85158-4da0-471b-8fc2-009f956a924a [ 1221.350343] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.350343] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.350343] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.350343] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.350343] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.350343] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b6b85158-4da0-471b-8fc2-009f956a924a already deleted. [ 1221.350343] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6b85158-4da0-471b-8fc2-009f956a924a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.355252] env[69506]: INFO networking_nsxv3.common.synchronization [None req-eb869f4f-2b9d-4b5a-b489-acf7f8326326 tempest-ServersTestJSON-1884356164 tempest-ServersTestJSON-1884356164-project-member] Enqueued Resource ID: 3a071d7d-92f1-4559-8dc2-314d4f1776fe with Priority: HIGHEST for action security_group_rules [ 1221.355252] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a071d7d-92f1-4559-8dc2-314d4f1776fe with Priority: HIGHEST for action security_group_rules [ 1221.355252] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a071d7d-92f1-4559-8dc2-314d4f1776fe taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.355252] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a071d7d-92f1-4559-8dc2-314d4f1776fe" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.355252] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a071d7d-92f1-4559-8dc2-314d4f1776fe" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.355252] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a071d7d-92f1-4559-8dc2-314d4f1776fe" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.355252] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a071d7d-92f1-4559-8dc2-314d4f1776fe',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.454828] env[69506]: INFO networking_nsxv3.common.synchronization [None req-e9a2121a-0619-4c0b-b3e0-69e6362966c0 tempest-ServersTestJSON-1884356164 tempest-ServersTestJSON-1884356164-project-member] Enqueued Resource ID: 3a071d7d-92f1-4559-8dc2-314d4f1776fe with Priority: HIGHEST for action security_group_rules [ 1221.454828] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a071d7d-92f1-4559-8dc2-314d4f1776fe with Priority: HIGHEST for action security_group_rules [ 1221.454828] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a071d7d-92f1-4559-8dc2-314d4f1776fe taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.454828] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a071d7d-92f1-4559-8dc2-314d4f1776fe" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.874551] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.874920] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.874920] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.875142] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.875254] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.875386] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a071d7d-92f1-4559-8dc2-314d4f1776fe already deleted. [ 1221.875515] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a071d7d-92f1-4559-8dc2-314d4f1776fe" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.876048] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a071d7d-92f1-4559-8dc2-314d4f1776fe" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.876213] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a071d7d-92f1-4559-8dc2-314d4f1776fe" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.876298] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a071d7d-92f1-4559-8dc2-314d4f1776fe',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.342156] env[69506]: INFO networking_nsxv3.common.synchronization [req-359f9374-87d5-419f-a835-5de9d0a2f9c5 req-0791e9b7-50d8-4e1b-a668-51e7686fbb7a tempest-DeleteServersTestJSON-1880805458 tempest-DeleteServersTestJSON-1880805458-project-member] Enqueued Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_members [ 1222.345487] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_members [ 1222.345833] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.345956] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.345956] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.346345] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.346345] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.346587] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.346587] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.346683] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.346731] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.346784] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.397847] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.398054] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.398054] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.398276] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.398442] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.398442] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a071d7d-92f1-4559-8dc2-314d4f1776fe already deleted. [ 1222.398543] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a071d7d-92f1-4559-8dc2-314d4f1776fe" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.666847] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-628 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.667131] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-628" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.667356] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-628" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.667791] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-628" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.668087] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.668322] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.669169] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.669169] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.669169] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.670172] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1222.670172] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1222.670172] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1222.670172] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1222.670172] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1222.670172] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1222.671307] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1222.689631] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1222.689797] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1222.689943] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1222.690153] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-628" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.690555] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-4648f376-c2ee-4806-bf3c-70644374f798 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.690768] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-4648f376-c2ee-4806-bf3c-70644374f798" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.690887] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-4648f376-c2ee-4806-bf3c-70644374f798" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.691257] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-4648f376-c2ee-4806-bf3c-70644374f798" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.691397] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4648f376-c2ee-4806-bf3c-70644374f798',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.849436] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.849646] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.849840] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.849965] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.850160] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.850304] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.850443] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.850804] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.850804] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.850804] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.851111] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d is going to be updated. [ 1222.874514] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.875278] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.875278] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.875278] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.875729] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.884324] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: IN_PROGRESS for 2s [ 1223.193521] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.193937] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.194114] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.194436] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.194602] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.194774] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 4648f376-c2ee-4806-bf3c-70644374f798 not found, creating... [ 1223.195115] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.195298] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.195427] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.195672] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.195823] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.196146] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.196308] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.196431] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.196649] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.196795] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.196944] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 4648f376-c2ee-4806-bf3c-70644374f798 is going to be created. [ 1223.216857] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.217102] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.217234] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.217516] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.217758] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.218012] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-4648f376-c2ee-4806-bf3c-70644374f798" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.242126] env[69506]: INFO networking_nsxv3.common.synchronization [None req-5ae02577-2cea-4922-97b1-6f3b03949ec6 None None] Enqueued Resource ID: 836cb138-447c-4cf2-9b5a-484f6142b3f6 with Priority: HIGHEST for action port [ 1223.242905] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 836cb138-447c-4cf2-9b5a-484f6142b3f6 with Priority: HIGHEST for action port [ 1223.243485] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-836cb138-447c-4cf2-9b5a-484f6142b3f6 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.243621] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-836cb138-447c-4cf2-9b5a-484f6142b3f6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.243852] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-836cb138-447c-4cf2-9b5a-484f6142b3f6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.244089] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-836cb138-447c-4cf2-9b5a-484f6142b3f6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.244176] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('836cb138-447c-4cf2-9b5a-484f6142b3f6',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.746735] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 836cb138-447c-4cf2-9b5a-484f6142b3f6 [ 1223.747079] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.747267] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.747368] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.747658] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.747780] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.747910] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:836cb138-447c-4cf2-9b5a-484f6142b3f6 already deleted. [ 1223.748030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-836cb138-447c-4cf2-9b5a-484f6142b3f6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.903193] env[69506]: INFO networking_nsxv3.common.synchronization [req-359f9374-87d5-419f-a835-5de9d0a2f9c5 req-fefd4399-a15d-4d77-b37a-3783cf0901f1 service nova] Enqueued Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_rules [ 1223.903420] env[69506]: INFO networking_nsxv3.common.synchronization [req-359f9374-87d5-419f-a835-5de9d0a2f9c5 req-fefd4399-a15d-4d77-b37a-3783cf0901f1 service nova] Enqueued Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_members [ 1223.903462] env[69506]: INFO networking_nsxv3.common.synchronization [req-359f9374-87d5-419f-a835-5de9d0a2f9c5 req-fefd4399-a15d-4d77-b37a-3783cf0901f1 service nova] Enqueued Resource ID: 4648f376-c2ee-4806-bf3c-70644374f798 with Priority: HIGHEST for action port [ 1223.903675] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_rules [ 1223.903824] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_members [ 1223.903902] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4648f376-c2ee-4806-bf3c-70644374f798 with Priority: HIGHEST for action port [ 1223.904488] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.904564] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.904628] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.904823] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.904900] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.905803] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.905912] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.906124] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-4648f376-c2ee-4806-bf3c-70644374f798 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.906224] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4648f376-c2ee-4806-bf3c-70644374f798" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.906289] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4648f376-c2ee-4806-bf3c-70644374f798" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.906447] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4648f376-c2ee-4806-bf3c-70644374f798" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.906530] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4648f376-c2ee-4806-bf3c-70644374f798',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.408427] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.408591] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.408692] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4648f376-c2ee-4806-bf3c-70644374f798 with status ACTIVE [ 1224.408863] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.408971] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.409051] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.409275] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.409365] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.409541] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.409639] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.409708] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.409860] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.409938] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.410260] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.410260] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.410362] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.410432] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.410468] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.410557] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4648f376-c2ee-4806-bf3c-70644374f798 is going to be updated. [ 1224.429493] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.429493] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.429673] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.429711] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.429827] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.429978] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4648f376-c2ee-4806-bf3c-70644374f798" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.894868] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: SUCCESS [ 1224.895085] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d deletion is rescheduled due to dependency. [ 1224.895202] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.895358] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.895569] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.895748] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.895863] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.895927] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.896107] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.896188] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.896282] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.966714] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-697 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.967044] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-697" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.967145] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-697" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.967457] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-697" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.967739] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.967909] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.968041] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.968266] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.968413] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.968626] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1224.968745] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1224.968858] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1224.968967] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1224.969091] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1224.969309] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1224.969486] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1224.986025] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1224.986025] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.016 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1224.986141] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1224.986257] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-697" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.986544] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-f3c16c0c-aa52-4ccc-8f50-305eb5529b34 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.986706] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-f3c16c0c-aa52-4ccc-8f50-305eb5529b34" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.986847] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-f3c16c0c-aa52-4ccc-8f50-305eb5529b34" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.987106] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-f3c16c0c-aa52-4ccc-8f50-305eb5529b34" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.987942] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3c16c0c-aa52-4ccc-8f50-305eb5529b34',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.398702] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.490145] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.490575] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.490575] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.490891] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.491071] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.491376] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.491544] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.491669] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.492051] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.492203] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.492497] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.492739] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.492867] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.493099] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.493257] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.493407] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: f3c16c0c-aa52-4ccc-8f50-305eb5529b34 is going to be updated. [ 1225.514650] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.514650] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.514650] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.514650] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.514913] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.515137] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-f3c16c0c-aa52-4ccc-8f50-305eb5529b34" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.901539] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.192039] env[69506]: INFO networking_nsxv3.common.synchronization [req-b18dbae3-c71a-423d-8b0c-a34561e4a6d4 req-fa1c53d0-9ca3-4f14-8ed5-420e8e018d71 service nova] Enqueued Resource ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 with Priority: HIGHEST for action security_group_rules [ 1226.192039] env[69506]: INFO networking_nsxv3.common.synchronization [req-b18dbae3-c71a-423d-8b0c-a34561e4a6d4 req-fa1c53d0-9ca3-4f14-8ed5-420e8e018d71 service nova] Enqueued Resource ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 with Priority: HIGHEST for action security_group_members [ 1226.192039] env[69506]: INFO networking_nsxv3.common.synchronization [req-b18dbae3-c71a-423d-8b0c-a34561e4a6d4 req-fa1c53d0-9ca3-4f14-8ed5-420e8e018d71 service nova] Enqueued Resource ID: f3c16c0c-aa52-4ccc-8f50-305eb5529b34 with Priority: HIGHEST for action port [ 1226.192519] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 with Priority: HIGHEST for action security_group_rules [ 1226.192571] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 with Priority: HIGHEST for action security_group_members [ 1226.192725] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c16c0c-aa52-4ccc-8f50-305eb5529b34 with Priority: HIGHEST for action port [ 1226.193019] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.193188] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.193302] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.193470] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.193554] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fca9cd47-c1fb-4023-8f12-fa1b22a98fd8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.194389] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.194490] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.194559] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.194733] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.194869] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.194964] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.195062] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.195176] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.195259] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.195347] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fca9cd47-c1fb-4023-8f12-fa1b22a98fd8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.196062] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3c16c0c-aa52-4ccc-8f50-305eb5529b34 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.196172] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3c16c0c-aa52-4ccc-8f50-305eb5529b34" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.196274] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3c16c0c-aa52-4ccc-8f50-305eb5529b34" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.196385] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3c16c0c-aa52-4ccc-8f50-305eb5529b34" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.196503] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3c16c0c-aa52-4ccc-8f50-305eb5529b34',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.404423] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.404615] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.404724] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.404977] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.405190] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.405377] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d is going to be updated. [ 1226.435931] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.436142] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.436142] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.436351] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.436510] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.445681] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: IN_PROGRESS for 2s [ 1226.698257] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fca9cd47-c1fb-4023-8f12-fa1b22a98fd8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.699348] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.699497] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.702209] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f3c16c0c-aa52-4ccc-8f50-305eb5529b34 with status ACTIVE [ 1226.702392] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.702521] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.702597] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.702815] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.702978] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.703085] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.703184] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.703246] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.703394] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.703471] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.703650] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.703757] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.703827] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.703966] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.704053] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.704139] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f3c16c0c-aa52-4ccc-8f50-305eb5529b34 is going to be updated. [ 1226.724498] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.724622] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.724661] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.724848] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.724979] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.725153] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3c16c0c-aa52-4ccc-8f50-305eb5529b34" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.200690] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fca9cd47-c1fb-4023-8f12-fa1b22a98fd8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.703715] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.703933] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.704064] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.704364] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.704482] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.704601] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 is going to be updated. [ 1227.730459] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.730612] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.730711] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.730934] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.731088] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.739465] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 in Status: IN_PROGRESS for 2s [ 1227.769644] env[69506]: INFO networking_nsxv3.common.synchronization [req-98070717-e6d1-48a8-a042-d35fee4ca77e req-258175c8-a517-4a30-8c67-2421401e61d9 tempest-ServersTestJSON-1884356164 tempest-ServersTestJSON-1884356164-project-member] Enqueued Resource ID: 3a071d7d-92f1-4559-8dc2-314d4f1776fe with Priority: HIGHEST for action security_group_members [ 1227.770166] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a071d7d-92f1-4559-8dc2-314d4f1776fe with Priority: HIGHEST for action security_group_members [ 1227.770484] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a071d7d-92f1-4559-8dc2-314d4f1776fe taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.770609] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a071d7d-92f1-4559-8dc2-314d4f1776fe" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.770702] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a071d7d-92f1-4559-8dc2-314d4f1776fe" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.771105] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a071d7d-92f1-4559-8dc2-314d4f1776fe" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.771274] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.771392] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.771466] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.771640] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.771845] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.771845] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a071d7d-92f1-4559-8dc2-314d4f1776fe',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.151755] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-842 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.151755] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-842" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.151755] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-842" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.152110] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-842" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.152440] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.152610] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.152758] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.153019] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.153175] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.153422] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1228.153567] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1228.153703] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1228.153825] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1228.153943] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1228.154073] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1228.154214] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1228.177392] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1228.177551] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1228.177691] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1228.177866] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-842" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.178181] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-87a7a80e-2b7f-4100-b33d-96401369431b taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.178356] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-87a7a80e-2b7f-4100-b33d-96401369431b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.178481] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-87a7a80e-2b7f-4100-b33d-96401369431b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.178797] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-87a7a80e-2b7f-4100-b33d-96401369431b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.178943] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87a7a80e-2b7f-4100-b33d-96401369431b',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.276726] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.276726] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.276726] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.276726] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.276726] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.277226] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.277226] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.277226] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.277226] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.277226] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.277408] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a071d7d-92f1-4559-8dc2-314d4f1776fe already deleted. [ 1228.277408] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a071d7d-92f1-4559-8dc2-314d4f1776fe" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.455889] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: SUCCESS [ 1228.456149] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.456651] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.456864] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.457099] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.457301] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.457301] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.457445] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.457525] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.457609] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.457698] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.680833] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.681163] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.681351] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.681682] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.681892] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.682113] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 87a7a80e-2b7f-4100-b33d-96401369431b not found, creating... [ 1228.682453] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.682704] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.682863] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.683152] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.683344] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.683682] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.683900] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.684152] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.684400] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.684588] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.684776] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 87a7a80e-2b7f-4100-b33d-96401369431b is going to be created. [ 1228.704318] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.704510] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.704639] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.704883] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.705180] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.706050] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-87a7a80e-2b7f-4100-b33d-96401369431b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.960075] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.960259] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.960259] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.960441] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.960612] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.960718] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.960806] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.960966] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.961076] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.961183] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.961337] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.961430] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.961489] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.961630] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.961768] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.961859] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.961921] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.962063] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.962139] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.962217] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.962302] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.376743] env[69506]: INFO networking_nsxv3.common.synchronization [req-98070717-e6d1-48a8-a042-d35fee4ca77e req-f294edda-229b-4d11-bb36-2d67df6eda67 service nova] Enqueued Resource ID: 3a071d7d-92f1-4559-8dc2-314d4f1776fe with Priority: HIGHEST for action security_group_rules [ 1229.377276] env[69506]: INFO networking_nsxv3.common.synchronization [req-98070717-e6d1-48a8-a042-d35fee4ca77e req-f294edda-229b-4d11-bb36-2d67df6eda67 service nova] Enqueued Resource ID: 3a071d7d-92f1-4559-8dc2-314d4f1776fe with Priority: HIGHEST for action security_group_members [ 1229.377276] env[69506]: INFO networking_nsxv3.common.synchronization [req-98070717-e6d1-48a8-a042-d35fee4ca77e req-f294edda-229b-4d11-bb36-2d67df6eda67 service nova] Enqueued Resource ID: 87a7a80e-2b7f-4100-b33d-96401369431b with Priority: HIGHEST for action port [ 1229.377377] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a071d7d-92f1-4559-8dc2-314d4f1776fe with Priority: HIGHEST for action security_group_rules [ 1229.378073] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a071d7d-92f1-4559-8dc2-314d4f1776fe with Priority: HIGHEST for action security_group_members [ 1229.378228] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87a7a80e-2b7f-4100-b33d-96401369431b with Priority: HIGHEST for action port [ 1229.378908] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a071d7d-92f1-4559-8dc2-314d4f1776fe taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.379047] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a071d7d-92f1-4559-8dc2-314d4f1776fe" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.379122] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a071d7d-92f1-4559-8dc2-314d4f1776fe" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.379320] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a071d7d-92f1-4559-8dc2-314d4f1776fe" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.379399] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a071d7d-92f1-4559-8dc2-314d4f1776fe',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.380309] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a071d7d-92f1-4559-8dc2-314d4f1776fe taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.380435] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a071d7d-92f1-4559-8dc2-314d4f1776fe" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.381028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a071d7d-92f1-4559-8dc2-314d4f1776fe" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.381028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a071d7d-92f1-4559-8dc2-314d4f1776fe" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.381028] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.381028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.381028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.381381] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.381381] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.381381] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a071d7d-92f1-4559-8dc2-314d4f1776fe',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.382041] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-87a7a80e-2b7f-4100-b33d-96401369431b taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.383086] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87a7a80e-2b7f-4100-b33d-96401369431b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.383086] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87a7a80e-2b7f-4100-b33d-96401369431b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.383086] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87a7a80e-2b7f-4100-b33d-96401369431b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.383086] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87a7a80e-2b7f-4100-b33d-96401369431b',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.464495] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d: rpc.has_security_group_logging(os_id): False [ 1229.483069] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.483236] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.483290] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.483470] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.483562] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.483848] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.483956] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.484026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.484160] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.484251] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.484425] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.484517] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.484579] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.484709] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.484788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.484995] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.485130] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.485191] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.485331] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.485406] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.485489] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d is going to be updated. [ 1229.541822] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.541976] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.542026] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.542226] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.542362] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.556149] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: IN_PROGRESS for 2s [ 1229.750030] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 in Status: SUCCESS [ 1229.750237] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.750454] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.750699] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.750878] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.750994] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.751069] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.751262] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.751431] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.751592] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.751700] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fca9cd47-c1fb-4023-8f12-fa1b22a98fd8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.885510] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a071d7d-92f1-4559-8dc2-314d4f1776fe taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.885663] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a071d7d-92f1-4559-8dc2-314d4f1776fe" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.885867] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a071d7d-92f1-4559-8dc2-314d4f1776fe',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.886798] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 87a7a80e-2b7f-4100-b33d-96401369431b with status ACTIVE [ 1229.886996] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.887130] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.887197] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.887405] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.887490] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.887665] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.887764] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.887866] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.887988] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.888061] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.888237] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.888328] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.888383] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.888690] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.888690] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.888690] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 87a7a80e-2b7f-4100-b33d-96401369431b is going to be updated. [ 1229.908262] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.908383] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.908451] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.908645] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.908816] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.908932] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87a7a80e-2b7f-4100-b33d-96401369431b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.254381] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fca9cd47-c1fb-4023-8f12-fa1b22a98fd8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.390891] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a071d7d-92f1-4559-8dc2-314d4f1776fe',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.758241] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fca9cd47-c1fb-4023-8f12-fa1b22a98fd8: rpc.has_security_group_logging(os_id): False [ 1230.774700] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.774919] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.774967] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.775180] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.775293] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.775550] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.775699] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.775769] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.775924] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.776039] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.776141] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 is going to be updated. [ 1230.834782] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.835030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.835139] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.835298] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.835441] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.849302] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 in Status: IN_PROGRESS for 2s [ 1230.893170] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.893321] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.893321] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.893507] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.893612] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.893737] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a071d7d-92f1-4559-8dc2-314d4f1776fe is going to be created. [ 1230.916199] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.916349] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.916449] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.916661] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.916835] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.926458] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a071d7d-92f1-4559-8dc2-314d4f1776fe in Status: UNINITIALIZED for 2s [ 1231.570860] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: SUCCESS [ 1231.571223] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.863676] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 in Status: SUCCESS [ 1232.864085] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.937455] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a071d7d-92f1-4559-8dc2-314d4f1776fe in Status: SUCCESS [ 1232.937711] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a071d7d-92f1-4559-8dc2-314d4f1776fe" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.937868] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a071d7d-92f1-4559-8dc2-314d4f1776fe" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.938154] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a071d7d-92f1-4559-8dc2-314d4f1776fe" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.938359] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.938479] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.938546] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.938728] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.938815] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.938903] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a071d7d-92f1-4559-8dc2-314d4f1776fe" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.938995] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3a071d7d-92f1-4559-8dc2-314d4f1776fe',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.441443] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3a071d7d-92f1-4559-8dc2-314d4f1776fe',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.944347] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3a071d7d-92f1-4559-8dc2-314d4f1776fe: rpc.has_security_group_logging(os_id): False [ 1233.963480] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.963701] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.963799] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.964111] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.964245] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.964557] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.964712] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.964808] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.965035] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.965132] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.965253] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a071d7d-92f1-4559-8dc2-314d4f1776fe is going to be created. [ 1234.024436] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.024664] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.024724] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.024942] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.025158] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.034850] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a071d7d-92f1-4559-8dc2-314d4f1776fe in Status: IN_PROGRESS for 2s [ 1234.380178] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1234.380286] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1236.049173] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a071d7d-92f1-4559-8dc2-314d4f1776fe in Status: SUCCESS [ 1236.049577] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a071d7d-92f1-4559-8dc2-314d4f1776fe" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.381722] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1239.382040] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1243.002518] env[69506]: INFO networking_nsxv3.common.synchronization [req-7d7509b7-6444-45cf-92ea-3e445a23fdb2 req-af31e222-5c3d-45ab-8a1d-015840fc28d8 tempest-ServerActionsTestOtherB-347258904 tempest-ServerActionsTestOtherB-347258904-project-member] Enqueued Resource ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 with Priority: HIGHEST for action security_group_members [ 1243.003452] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 with Priority: HIGHEST for action security_group_members [ 1243.003695] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.003820] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.003903] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.004140] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.004304] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.004412] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.004477] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.005325] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.005462] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.005573] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fca9cd47-c1fb-4023-8f12-fa1b22a98fd8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.508248] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.508451] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.508495] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.508688] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.508781] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.508983] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.509103] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.509168] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.509322] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.509399] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.509487] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 is going to be updated. [ 1243.539724] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.539921] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.539921] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.540097] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.540233] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.548128] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 in Status: IN_PROGRESS for 2s [ 1245.558281] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 in Status: SUCCESS [ 1245.558592] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 deletion is rescheduled due to dependency. [ 1245.558592] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.004630] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1248.005035] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1253.005379] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1253.005734] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1258.006013] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1258.006254] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1260.556310] env[69506]: INFO networking_nsxv3.common.synchronization [req-3ceb478b-3743-4cbd-a8a9-ef3b287b5bd6 req-cc66306d-a923-4d69-ac61-a3553cbb8272 tempest-DeleteServersTestJSON-1880805458 tempest-DeleteServersTestJSON-1880805458-project-member] Enqueued Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_members [ 1260.556310] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGHEST for action security_group_members [ 1260.557193] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.557193] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.557193] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.557193] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.557193] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.557193] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.557443] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.557443] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.557525] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.557568] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.060289] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.060521] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.060521] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.060857] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.060995] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.061293] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.061435] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.061526] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.061719] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.061821] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.061933] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d is going to be updated. [ 1261.088621] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.088744] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.088820] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.088999] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.089144] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.098395] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: IN_PROGRESS for 2s [ 1263.109642] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d in Status: SUCCESS [ 1263.109642] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d deletion is rescheduled due to dependency. [ 1263.109642] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.557972] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1265.557972] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1267.013826] env[69506]: INFO networking_nsxv3.common.synchronization [req-b3116c1a-b39b-4b20-9e60-42e4660e5e9d req-eca1ad08-45c1-4538-be07-be0775f21f76 tempest-AttachVolumeNegativeTest-402732870 tempest-AttachVolumeNegativeTest-402732870-project-member] Enqueued Resource ID: d91620e4-b545-4104-a2d6-4f8e42eac0c0 with Priority: HIGHEST for action security_group_members [ 1267.014419] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d91620e4-b545-4104-a2d6-4f8e42eac0c0 with Priority: HIGHEST for action security_group_members [ 1267.014744] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-d91620e4-b545-4104-a2d6-4f8e42eac0c0 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.015137] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d91620e4-b545-4104-a2d6-4f8e42eac0c0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.015137] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d91620e4-b545-4104-a2d6-4f8e42eac0c0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.015267] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d91620e4-b545-4104-a2d6-4f8e42eac0c0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.015428] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.015529] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.015588] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.015746] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.015821] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.015916] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d91620e4-b545-4104-a2d6-4f8e42eac0c0',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.517966] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.518142] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.518221] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.518430] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.518528] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.518727] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.518871] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.518941] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.519110] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.519195] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.519284] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d91620e4-b545-4104-a2d6-4f8e42eac0c0 is going to be updated. [ 1267.547470] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.547470] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.547470] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.547470] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.547470] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.555922] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d91620e4-b545-4104-a2d6-4f8e42eac0c0 in Status: IN_PROGRESS for 2s [ 1269.566075] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d91620e4-b545-4104-a2d6-4f8e42eac0c0 in Status: SUCCESS [ 1269.566418] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d91620e4-b545-4104-a2d6-4f8e42eac0c0 deletion is rescheduled due to dependency. [ 1269.566418] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d91620e4-b545-4104-a2d6-4f8e42eac0c0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.313401] env[69506]: INFO networking_nsxv3.common.synchronization [req-a80d2b8e-c8d8-4967-ad3c-5276b202bb95 req-c8176191-a80c-4e60-a926-882905623c7d tempest-ServerActionsTestJSON-78405165 tempest-ServerActionsTestJSON-78405165-project-member] Enqueued Resource ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 with Priority: HIGHEST for action security_group_members [ 1270.313593] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 with Priority: HIGHEST for action security_group_members [ 1270.313886] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.314659] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.314659] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.314659] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.314659] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.314659] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.314899] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.314899] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.314956] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.315074] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96b2c90a-a7a0-4dcb-8212-5e459d8d4793',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.817665] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.818087] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.818087] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.818245] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.818245] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.818396] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.818497] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.818560] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.818712] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.818790] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.818877] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 is going to be updated. [ 1270.843937] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.844101] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.844143] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.844316] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.844443] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.852078] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 in Status: IN_PROGRESS for 2s [ 1272.862900] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 in Status: SUCCESS [ 1272.863365] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 deletion is rescheduled due to dependency. [ 1272.863365] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.314364] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1275.314364] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1277.281602] env[69506]: INFO networking_nsxv3.common.synchronization [req-69df5d28-1f64-44ab-b81d-d4aee596fee6 req-736d1116-db3d-4555-acaf-c7826859794e tempest-ServerActionsTestJSON-78405165 tempest-ServerActionsTestJSON-78405165-project-member] Enqueued Resource ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 with Priority: HIGHEST for action security_group_members [ 1277.281602] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 with Priority: HIGHEST for action security_group_members [ 1277.281900] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.281954] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.281995] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.282206] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.282370] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.282468] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.282529] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.282672] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.282756] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.282840] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96b2c90a-a7a0-4dcb-8212-5e459d8d4793',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.536938] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-656 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.537188] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-656" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.537321] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-656" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.537595] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-656" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.537858] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.538141] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.538303] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.538536] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.538691] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.538910] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1277.539040] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1277.539156] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1277.539267] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1277.539379] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1277.539491] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1277.539625] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1277.559597] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1277.559766] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1277.559914] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1277.560120] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-656" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.560437] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-d2459247-da8f-4a7b-981c-b802b8ce0cfa taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.560620] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-d2459247-da8f-4a7b-981c-b802b8ce0cfa" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.560735] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-d2459247-da8f-4a7b-981c-b802b8ce0cfa" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.561080] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-d2459247-da8f-4a7b-981c-b802b8ce0cfa" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.561230] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2459247-da8f-4a7b-981c-b802b8ce0cfa',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.785298] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.785469] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.785542] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.786149] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.786149] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.786149] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.786327] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.786327] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.786458] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.786581] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.786718] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 is going to be updated. [ 1277.813341] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.813481] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.813593] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.813723] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.813856] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.823772] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 in Status: IN_PROGRESS for 2s [ 1278.068096] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.068374] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.068519] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.068838] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.069043] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.069222] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port d2459247-da8f-4a7b-981c-b802b8ce0cfa not found, creating... [ 1278.069496] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.069682] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.069809] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.070070] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.070233] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.070541] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.070713] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.070845] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.071118] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.071386] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.071629] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: d2459247-da8f-4a7b-981c-b802b8ce0cfa is going to be created. [ 1278.090084] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.090315] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.090468] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.090737] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.091029] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.091303] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-d2459247-da8f-4a7b-981c-b802b8ce0cfa" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.753376] env[69506]: INFO networking_nsxv3.common.synchronization [req-69df5d28-1f64-44ab-b81d-d4aee596fee6 req-dd7df166-2f4e-4b1d-b7c6-e789708bafb3 service nova] Enqueued Resource ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 with Priority: HIGHEST for action security_group_rules [ 1278.753665] env[69506]: INFO networking_nsxv3.common.synchronization [req-69df5d28-1f64-44ab-b81d-d4aee596fee6 req-dd7df166-2f4e-4b1d-b7c6-e789708bafb3 service nova] Enqueued Resource ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 with Priority: HIGHEST for action security_group_members [ 1278.753721] env[69506]: INFO networking_nsxv3.common.synchronization [req-69df5d28-1f64-44ab-b81d-d4aee596fee6 req-dd7df166-2f4e-4b1d-b7c6-e789708bafb3 service nova] Enqueued Resource ID: d2459247-da8f-4a7b-981c-b802b8ce0cfa with Priority: HIGHEST for action port [ 1278.754309] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 with Priority: HIGHEST for action security_group_rules [ 1278.754621] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 with Priority: HIGHEST for action security_group_members [ 1278.754621] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2459247-da8f-4a7b-981c-b802b8ce0cfa with Priority: HIGHEST for action port [ 1278.755119] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.755311] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.755429] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.755681] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.756846] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('96b2c90a-a7a0-4dcb-8212-5e459d8d4793',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.756994] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.757066] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.758635] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-d2459247-da8f-4a7b-981c-b802b8ce0cfa taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.758635] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d2459247-da8f-4a7b-981c-b802b8ce0cfa" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.758635] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d2459247-da8f-4a7b-981c-b802b8ce0cfa" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.758635] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d2459247-da8f-4a7b-981c-b802b8ce0cfa" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.758635] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2459247-da8f-4a7b-981c-b802b8ce0cfa',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.772584] env[69506]: INFO networking_nsxv3.common.synchronization [req-8bfbdeec-5cd5-48a7-ab84-40793e0ea382 req-f91a9c78-37f7-43a2-9913-c88a5d95445e tempest-ServersTestJSON-1884356164 tempest-ServersTestJSON-1884356164-project-member] Enqueued Resource ID: 3a071d7d-92f1-4559-8dc2-314d4f1776fe with Priority: HIGHEST for action security_group_members [ 1278.773568] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a071d7d-92f1-4559-8dc2-314d4f1776fe with Priority: HIGHEST for action security_group_members [ 1278.773896] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a071d7d-92f1-4559-8dc2-314d4f1776fe taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.774028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a071d7d-92f1-4559-8dc2-314d4f1776fe" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.774114] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a071d7d-92f1-4559-8dc2-314d4f1776fe" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.774331] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a071d7d-92f1-4559-8dc2-314d4f1776fe" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.774486] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.774585] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.774649] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.774798] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.774885] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.774979] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a071d7d-92f1-4559-8dc2-314d4f1776fe',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.260877] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.261057] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.261239] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d2459247-da8f-4a7b-981c-b802b8ce0cfa with status ACTIVE [ 1279.261437] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.261552] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.261609] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.261823] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.261914] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.262100] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.262196] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.262283] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.262404] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.262482] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.262661] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.262753] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.262814] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.262966] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.263053] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.263136] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d2459247-da8f-4a7b-981c-b802b8ce0cfa is going to be updated. [ 1279.277723] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.277853] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.278091] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.278168] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.278207] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.278372] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.278467] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.278529] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.278682] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.278757] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.278840] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a071d7d-92f1-4559-8dc2-314d4f1776fe is going to be updated. [ 1279.282593] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.282706] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.282765] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.282912] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.283045] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.283194] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d2459247-da8f-4a7b-981c-b802b8ce0cfa" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.310211] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.310375] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.310424] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.310554] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.310685] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.319014] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a071d7d-92f1-4559-8dc2-314d4f1776fe in Status: IN_PROGRESS for 2s [ 1279.832909] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 in Status: SUCCESS [ 1279.832909] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 deletion is rescheduled due to dependency. [ 1279.833244] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.833244] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.833426] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.833606] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.833735] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.833788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.833929] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.834016] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.834117] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96b2c90a-a7a0-4dcb-8212-5e459d8d4793',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.336318] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('96b2c90a-a7a0-4dcb-8212-5e459d8d4793',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.838770] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('96b2c90a-a7a0-4dcb-8212-5e459d8d4793',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.328917] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a071d7d-92f1-4559-8dc2-314d4f1776fe in Status: SUCCESS [ 1281.329125] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a071d7d-92f1-4559-8dc2-314d4f1776fe deletion is rescheduled due to dependency. [ 1281.329245] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a071d7d-92f1-4559-8dc2-314d4f1776fe" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.340913] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.341069] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.341144] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.341473] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.341575] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.341676] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 is going to be updated. [ 1281.366824] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.366980] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.367050] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.367264] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.367409] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.378490] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 in Status: IN_PROGRESS for 2s [ 1283.389428] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 in Status: SUCCESS [ 1283.389772] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.390015] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.390342] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.390637] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.390845] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.390982] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.391260] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.391402] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.391578] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.391737] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('96b2c90a-a7a0-4dcb-8212-5e459d8d4793',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.774966] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1283.775201] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1283.894545] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('96b2c90a-a7a0-4dcb-8212-5e459d8d4793',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.398866] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 96b2c90a-a7a0-4dcb-8212-5e459d8d4793: rpc.has_security_group_logging(os_id): False [ 1284.416074] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.416298] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.416298] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.416499] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.416577] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.416805] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.416942] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.416942] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.417109] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.417180] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.417270] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 is going to be updated. [ 1284.477914] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.477914] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.477914] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.477914] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.477914] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.489497] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 in Status: IN_PROGRESS for 2s [ 1286.503685] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 in Status: SUCCESS [ 1286.503989] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.652707] env[69506]: INFO networking_nsxv3.common.synchronization [None req-e6ef7965-0afe-49e4-920e-3fdea217d1fa None None] Enqueued Resource ID: 67ce8191-f55b-4b42-998a-7b9fb5e5af91 with Priority: HIGHEST for action port [ 1286.653088] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67ce8191-f55b-4b42-998a-7b9fb5e5af91 with Priority: HIGHEST for action port [ 1286.653729] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-67ce8191-f55b-4b42-998a-7b9fb5e5af91 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.653859] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67ce8191-f55b-4b42-998a-7b9fb5e5af91" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.653916] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67ce8191-f55b-4b42-998a-7b9fb5e5af91" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.654208] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67ce8191-f55b-4b42-998a-7b9fb5e5af91" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.654285] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67ce8191-f55b-4b42-998a-7b9fb5e5af91',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.157091] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 67ce8191-f55b-4b42-998a-7b9fb5e5af91 [ 1287.157322] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.158029] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.158029] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.158029] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.158029] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.158029] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:67ce8191-f55b-4b42-998a-7b9fb5e5af91 already deleted. [ 1287.158029] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67ce8191-f55b-4b42-998a-7b9fb5e5af91" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.439128] env[69506]: INFO networking_nsxv3.common.synchronization [None req-a7c5748f-8fef-4d61-8da5-7f6bdd85e349 tempest-ServerActionsTestOtherA-1202948283 tempest-ServerActionsTestOtherA-1202948283-project-member] Enqueued Resource ID: f6403698-8563-49d1-9b04-d2bd0547964d with Priority: HIGHEST for action security_group_rules [ 1287.439588] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6403698-8563-49d1-9b04-d2bd0547964d with Priority: HIGHEST for action security_group_rules [ 1287.439967] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6403698-8563-49d1-9b04-d2bd0547964d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.440097] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.440097] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.440330] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.440414] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6403698-8563-49d1-9b04-d2bd0547964d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.510499] env[69506]: INFO networking_nsxv3.common.synchronization [None req-81cd5ade-65af-417b-8e98-723301940732 tempest-ServerActionsTestOtherA-1202948283 tempest-ServerActionsTestOtherA-1202948283-project-member] Enqueued Resource ID: f6403698-8563-49d1-9b04-d2bd0547964d with Priority: HIGHEST for action security_group_rules [ 1287.511415] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6403698-8563-49d1-9b04-d2bd0547964d with Priority: HIGHEST for action security_group_rules [ 1287.511763] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6403698-8563-49d1-9b04-d2bd0547964d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.511904] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.970680] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.970867] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.970911] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.971157] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.971296] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.971490] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6403698-8563-49d1-9b04-d2bd0547964d already deleted. [ 1287.971609] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.972125] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.972310] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.972397] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6403698-8563-49d1-9b04-d2bd0547964d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.492397] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.492546] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.492614] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.492842] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.492931] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.493044] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6403698-8563-49d1-9b04-d2bd0547964d already deleted. [ 1288.493129] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.718517] env[69506]: INFO networking_nsxv3.common.synchronization [None req-bc21da75-21b5-4cb2-b305-0837373c4f17 None None] Enqueued Resource ID: 8f22f38c-998d-4857-b636-57b5dd548f44 with Priority: HIGHEST for action port [ 1288.718781] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f22f38c-998d-4857-b636-57b5dd548f44 with Priority: HIGHEST for action port [ 1288.719343] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f22f38c-998d-4857-b636-57b5dd548f44 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.719466] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f22f38c-998d-4857-b636-57b5dd548f44" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.719530] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f22f38c-998d-4857-b636-57b5dd548f44" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.719870] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f22f38c-998d-4857-b636-57b5dd548f44" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.719870] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f22f38c-998d-4857-b636-57b5dd548f44',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.225396] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8f22f38c-998d-4857-b636-57b5dd548f44 [ 1289.225618] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.225804] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.225895] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.226110] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.226602] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.226602] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8f22f38c-998d-4857-b636-57b5dd548f44 already deleted. [ 1289.226602] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f22f38c-998d-4857-b636-57b5dd548f44" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.750689] env[69506]: INFO networking_nsxv3.common.synchronization [req-44feca5b-bfd3-4bdf-9ae6-230e99fc8979 req-42a88dd3-4ddc-4ee6-94dc-d965708840a7 tempest-ServerActionsTestOtherA-1202948283 tempest-ServerActionsTestOtherA-1202948283-project-member] Enqueued Resource ID: f6403698-8563-49d1-9b04-d2bd0547964d with Priority: HIGHEST for action security_group_members [ 1292.751251] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6403698-8563-49d1-9b04-d2bd0547964d with Priority: HIGHEST for action security_group_members [ 1292.751665] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6403698-8563-49d1-9b04-d2bd0547964d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.751778] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.751778] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.752090] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.752261] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.752395] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.752461] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.752618] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.752738] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.752879] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6403698-8563-49d1-9b04-d2bd0547964d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.028337] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-258 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.028337] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-258" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.028525] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-258" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.028722] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-258" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.028987] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.029173] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.029279] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.029526] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.029642] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.029856] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1293.029975] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1293.030100] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1293.030212] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1293.030328] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1293.030439] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1293.030575] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1293.049898] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1293.050076] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1293.050210] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1293.050376] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-258" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.050650] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-c55a9800-1a5a-49a7-998f-9bec49a335bd taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.050816] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-c55a9800-1a5a-49a7-998f-9bec49a335bd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.050940] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-c55a9800-1a5a-49a7-998f-9bec49a335bd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.051230] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-c55a9800-1a5a-49a7-998f-9bec49a335bd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.051392] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c55a9800-1a5a-49a7-998f-9bec49a335bd',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.255036] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.255241] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.255241] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.255410] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.255502] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.255697] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.255809] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.255878] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.256015] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.256093] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.256180] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6403698-8563-49d1-9b04-d2bd0547964d already deleted. [ 1293.256259] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.553172] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.553384] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.553575] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.553862] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.554026] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.554192] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port c55a9800-1a5a-49a7-998f-9bec49a335bd not found, creating... [ 1293.554500] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.554716] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.554846] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.555076] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.555219] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.555508] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.555669] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.555793] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.555998] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.556150] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.556294] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: c55a9800-1a5a-49a7-998f-9bec49a335bd is going to be created. [ 1293.575205] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.575400] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.575529] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.575778] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.576010] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.576244] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-c55a9800-1a5a-49a7-998f-9bec49a335bd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.242115] env[69506]: INFO networking_nsxv3.common.synchronization [req-44feca5b-bfd3-4bdf-9ae6-230e99fc8979 req-fdc3a725-ffa7-4c52-9059-12cab80e4e44 service nova] Enqueued Resource ID: f6403698-8563-49d1-9b04-d2bd0547964d with Priority: HIGHEST for action security_group_rules [ 1294.242461] env[69506]: INFO networking_nsxv3.common.synchronization [req-44feca5b-bfd3-4bdf-9ae6-230e99fc8979 req-fdc3a725-ffa7-4c52-9059-12cab80e4e44 service nova] Enqueued Resource ID: f6403698-8563-49d1-9b04-d2bd0547964d with Priority: HIGHEST for action security_group_members [ 1294.242461] env[69506]: INFO networking_nsxv3.common.synchronization [req-44feca5b-bfd3-4bdf-9ae6-230e99fc8979 req-fdc3a725-ffa7-4c52-9059-12cab80e4e44 service nova] Enqueued Resource ID: c55a9800-1a5a-49a7-998f-9bec49a335bd with Priority: HIGHEST for action port [ 1294.242571] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6403698-8563-49d1-9b04-d2bd0547964d with Priority: HIGHEST for action security_group_rules [ 1294.242699] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6403698-8563-49d1-9b04-d2bd0547964d with Priority: HIGHEST for action security_group_members [ 1294.242793] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c55a9800-1a5a-49a7-998f-9bec49a335bd with Priority: HIGHEST for action port [ 1294.243372] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6403698-8563-49d1-9b04-d2bd0547964d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.243462] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.243526] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.243773] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.243847] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6403698-8563-49d1-9b04-d2bd0547964d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.244773] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6403698-8563-49d1-9b04-d2bd0547964d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.245292] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.246329] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.246550] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.246731] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.246850] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.247176] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.247176] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.248193] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.248348] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6403698-8563-49d1-9b04-d2bd0547964d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.249112] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-c55a9800-1a5a-49a7-998f-9bec49a335bd taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.249262] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c55a9800-1a5a-49a7-998f-9bec49a335bd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.249262] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c55a9800-1a5a-49a7-998f-9bec49a335bd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.249431] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c55a9800-1a5a-49a7-998f-9bec49a335bd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.249548] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c55a9800-1a5a-49a7-998f-9bec49a335bd',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.751905] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6403698-8563-49d1-9b04-d2bd0547964d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.752052] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.752249] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f6403698-8563-49d1-9b04-d2bd0547964d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.753155] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c55a9800-1a5a-49a7-998f-9bec49a335bd with status ACTIVE [ 1294.753339] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.753449] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.753548] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.753757] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.753847] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.754034] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.754136] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.754193] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.754334] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.754411] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.754620] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.754716] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.754775] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.754964] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.754996] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.755082] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c55a9800-1a5a-49a7-998f-9bec49a335bd is going to be updated. [ 1294.775306] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.775426] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.775483] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.775830] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.775830] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.775830] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c55a9800-1a5a-49a7-998f-9bec49a335bd" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.257398] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f6403698-8563-49d1-9b04-d2bd0547964d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.759364] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.759563] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.759615] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.759795] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.759887] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.759984] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6403698-8563-49d1-9b04-d2bd0547964d is going to be created. [ 1295.783852] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.784010] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.784057] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.784252] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.784400] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.792922] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6403698-8563-49d1-9b04-d2bd0547964d in Status: UNINITIALIZED for 2s [ 1297.802602] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6403698-8563-49d1-9b04-d2bd0547964d in Status: SUCCESS [ 1297.802960] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.802960] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.803191] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.803366] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.803480] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.803569] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.803741] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.803834] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.803922] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.804020] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f6403698-8563-49d1-9b04-d2bd0547964d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.305994] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f6403698-8563-49d1-9b04-d2bd0547964d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.808026] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f6403698-8563-49d1-9b04-d2bd0547964d: rpc.has_security_group_logging(os_id): False [ 1298.826246] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.826374] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.826446] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.826653] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.826745] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.826977] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.827097] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.827173] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.827307] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.827386] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.827472] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6403698-8563-49d1-9b04-d2bd0547964d is going to be created. [ 1298.881930] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.882086] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.882165] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.882298] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.882468] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.891949] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6403698-8563-49d1-9b04-d2bd0547964d in Status: IN_PROGRESS for 2s [ 1299.244068] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1299.244068] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1300.905040] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6403698-8563-49d1-9b04-d2bd0547964d in Status: SUCCESS [ 1300.905394] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.245357] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1304.245714] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1305.126865] env[69506]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1305.127036] env[69506]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] NSXv3 Agent Agent loop - iteration:3 started [ 1309.247303] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1309.247644] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1314.248223] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1314.248543] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1319.249388] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1319.249814] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1324.250807] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1324.250807] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1329.252597] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1329.252597] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1334.253947] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1334.254348] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1339.255307] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1339.255566] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1340.147466] env[69506]: INFO networking_nsxv3.common.synchronization [req-37f55d07-7e7d-4cc7-aad5-d43e8a808cf9 req-d964cd66-8e87-4238-8ce3-4a323b2b0b1a tempest-ServerActionsTestJSON-78405165 tempest-ServerActionsTestJSON-78405165-project-member] Enqueued Resource ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 with Priority: HIGHEST for action security_group_members [ 1340.148257] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 with Priority: HIGHEST for action security_group_members [ 1340.148613] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.148751] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.148823] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.149065] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.149240] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.149354] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.149421] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.149579] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.149658] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.149779] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96b2c90a-a7a0-4dcb-8212-5e459d8d4793',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.653088] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.653419] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.653419] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.653617] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.653617] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.653810] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.653910] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.653965] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.654156] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.654232] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.654322] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 is going to be updated. [ 1340.683062] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.683228] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.683293] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.683410] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.683537] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.690934] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 in Status: IN_PROGRESS for 2s [ 1341.064566] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.064768] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.064959] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.065349] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.065414] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.567917] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.069959] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.573074] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1342.573074] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1342.708672] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 in Status: SUCCESS [ 1342.708842] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 deletion is rescheduled due to dependency. [ 1342.708979] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.268422] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.268836] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.268836] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.268836] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.280231] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1343.281104] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.282351] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1343.320406] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.320636] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.320739] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.321042] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.346709] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.347976] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1343.348124] env[69506]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69506) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1343.348268] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1343.382344] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.382594] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.382640] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.382897] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.384594] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.384853] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1343.453025] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.453179] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.453256] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.453472] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.453784] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.454114] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1343.531854] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.532162] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.532162] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.532300] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.532580] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.532964] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:36. [ 1343.533085] env[69506]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'d91620e4-b545-4104-a2d6-4f8e42eac0c0', '28204c48-8cc9-4a78-9ae1-cbf9a28e9016', 'd0461c6a-1d2b-401e-b59f-af6eda84b6ca', '7d9ed455-9c3f-46b7-9453-8a5f9cfb0580', 'c29a3314-8167-42dc-9e04-3dc4cb967960', '3a071d7d-92f1-4559-8dc2-314d4f1776fe', '96b2c90a-a7a0-4dcb-8212-5e459d8d4793', '706a5462-e893-428d-beb2-737cbec00439', 'b50d66d8-0bc1-42fe-b025-b6e5287fc3df', '479009cc-bfe1-4ddc-a0f7-70c7b96b33dc', '0a27cb9c-bb13-44cb-a531-49610a94a36e', '64557eb9-9b83-42ab-99e4-278f5711a22e', '5387ebf9-b56f-4308-969a-3aa715cad9da', 'd52cf5b6-2860-4667-8ade-9e0529358ed1', 'fca9cd47-c1fb-4023-8f12-fa1b22a98fd8', '78caaaf6-868f-4043-93dd-d9a75a05d023', '3f946d66-543a-40be-9347-81d7eb4f4e31', '1ba3a620-9fd8-44d2-8d21-20dfc5b1648d', '20940711-36df-48c2-b8ae-df2cfecaebc8', 'eee25a0e-a423-45cd-80e8-327029ae7dc4', '7e307bb5-2c7b-4260-88ec-90f13f2de5d2', '7d0db323-2ed4-4f6a-a30a-405b16133cb2', 'c141011f-1c58-45cb-b73c-ad882255b77a', 'f6403698-8563-49d1-9b04-d2bd0547964d', '823c6679-501c-4ec2-9d9f-f49b7cc1205d', '9f130eeb-c453-4570-b0fe-743f47890102', '40ac1d9f-7f09-4603-ba34-b3f5910e1da2', '008501d4-938b-4336-9c1d-ef3665f7d09d', 'cb920054-1c0f-4a74-aad1-8ca7ce036993', '65fb79f7-95e7-4be9-b5bb-64c57bc42333', '56c2fe94-2993-4f31-a331-b0611a88cec2', '9ce980c1-0c92-48ab-930f-2537a5f82269', '74f7fdee-99f0-4620-9ae9-86ee28797058', '9e830a1e-918a-49a7-b725-f68307282e6e', '39f6b94d-d05c-4309-8b06-e27ba3215b09', '0745f36a-3469-4c49-9c0f-8111fe1bd802'} {{(pid=69506) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1343.533238] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1343.549813] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.550030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.550030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.550216] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.550293] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.550406] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1343.550473] env[69506]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69506) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1343.550548] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1343.628046] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.628282] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.628282] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.628487] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.629624] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.629890] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1343.629972] env[69506]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69506) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1343.630083] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1343.630158] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1343.630237] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/36 resources of Type:Security Group Rules [ 1343.630308] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d91620e4-b545-4104-a2d6-4f8e42eac0c0 with Priority: HIGH for action security_group_rules [ 1343.630389] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 28204c48-8cc9-4a78-9ae1-cbf9a28e9016 with Priority: HIGH for action security_group_rules [ 1343.630456] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca with Priority: HIGH for action security_group_rules [ 1343.630518] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 with Priority: HIGH for action security_group_rules [ 1343.630580] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c29a3314-8167-42dc-9e04-3dc4cb967960 with Priority: HIGH for action security_group_rules [ 1343.630642] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3a071d7d-92f1-4559-8dc2-314d4f1776fe with Priority: HIGH for action security_group_rules [ 1343.630703] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 with Priority: HIGH for action security_group_rules [ 1343.630764] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 706a5462-e893-428d-beb2-737cbec00439 with Priority: HIGH for action security_group_rules [ 1343.630825] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b50d66d8-0bc1-42fe-b025-b6e5287fc3df with Priority: HIGH for action security_group_rules [ 1343.630887] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGH for action security_group_rules [ 1343.630949] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGH for action security_group_rules [ 1343.631025] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 64557eb9-9b83-42ab-99e4-278f5711a22e with Priority: HIGH for action security_group_rules [ 1343.631090] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5387ebf9-b56f-4308-969a-3aa715cad9da with Priority: HIGH for action security_group_rules [ 1343.631153] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 with Priority: HIGH for action security_group_rules [ 1343.631214] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 with Priority: HIGH for action security_group_rules [ 1343.631276] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 with Priority: HIGH for action security_group_rules [ 1343.631338] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 with Priority: HIGH for action security_group_rules [ 1343.631399] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGH for action security_group_rules [ 1343.631460] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 20940711-36df-48c2-b8ae-df2cfecaebc8 with Priority: HIGH for action security_group_rules [ 1343.631522] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: eee25a0e-a423-45cd-80e8-327029ae7dc4 with Priority: HIGH for action security_group_rules [ 1343.631620] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.110679] env[69506]: INFO networking_nsxv3.common.synchronization [req-21d52a17-d54e-4c10-9f9c-8524b5a67757 req-484d57b3-1562-45f5-920c-6bad6524306a tempest-ServerActionsTestOtherA-1202948283 tempest-ServerActionsTestOtherA-1202948283-project-member] Enqueued Resource ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 with Priority: HIGHEST for action security_group_members [ 1344.111166] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 with Priority: HIGHEST for action security_group_members [ 1344.111166] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d91620e4-b545-4104-a2d6-4f8e42eac0c0 with Priority: HIGH for action security_group_rules [ 1344.111166] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca with Priority: HIGH for action security_group_rules [ 1344.111166] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 with Priority: HIGH for action security_group_rules [ 1344.111299] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 with Priority: HIGH for action security_group_rules [ 1344.111299] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eee25a0e-a423-45cd-80e8-327029ae7dc4 with Priority: HIGH for action security_group_rules [ 1344.111423] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20940711-36df-48c2-b8ae-df2cfecaebc8 with Priority: HIGH for action security_group_rules [ 1344.111526] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d with Priority: HIGH for action security_group_rules [ 1344.111579] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 with Priority: HIGH for action security_group_rules [ 1344.111628] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 with Priority: HIGH for action security_group_rules [ 1344.111708] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 with Priority: HIGH for action security_group_rules [ 1344.111793] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5387ebf9-b56f-4308-969a-3aa715cad9da with Priority: HIGH for action security_group_rules [ 1344.111878] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64557eb9-9b83-42ab-99e4-278f5711a22e with Priority: HIGH for action security_group_rules [ 1344.111983] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e with Priority: HIGH for action security_group_rules [ 1344.112166] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc with Priority: HIGH for action security_group_rules [ 1344.112261] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b50d66d8-0bc1-42fe-b025-b6e5287fc3df with Priority: HIGH for action security_group_rules [ 1344.112350] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a071d7d-92f1-4559-8dc2-314d4f1776fe with Priority: HIGH for action security_group_rules [ 1344.112436] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 706a5462-e893-428d-beb2-737cbec00439 with Priority: HIGH for action security_group_rules [ 1344.112583] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c29a3314-8167-42dc-9e04-3dc4cb967960 with Priority: HIGH for action security_group_rules [ 1344.112674] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28204c48-8cc9-4a78-9ae1-cbf9a28e9016 with Priority: HIGH for action security_group_rules [ 1344.112762] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 with Priority: HIGH for action security_group_rules [ 1344.113049] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.113198] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.113250] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.113465] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.113621] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.113716] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.113768] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.113950] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.114058] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.114185] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ec4d2c8-aabb-404a-9e02-8eef8990ffe0',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.115427] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d91620e4-b545-4104-a2d6-4f8e42eac0c0 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.115552] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d91620e4-b545-4104-a2d6-4f8e42eac0c0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.115643] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d91620e4-b545-4104-a2d6-4f8e42eac0c0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.115805] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d91620e4-b545-4104-a2d6-4f8e42eac0c0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.115879] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d91620e4-b545-4104-a2d6-4f8e42eac0c0',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.116972] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0461c6a-1d2b-401e-b59f-af6eda84b6ca taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.117051] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.117102] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.117209] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.117283] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0461c6a-1d2b-401e-b59f-af6eda84b6ca',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.118733] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.118802] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.118855] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.118973] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.119059] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('96b2c90a-a7a0-4dcb-8212-5e459d8d4793',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.119821] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.119939] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.120034] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.120167] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.120290] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fca9cd47-c1fb-4023-8f12-fa1b22a98fd8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.120900] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eee25a0e-a423-45cd-80e8-327029ae7dc4 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.121073] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eee25a0e-a423-45cd-80e8-327029ae7dc4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.121154] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eee25a0e-a423-45cd-80e8-327029ae7dc4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.121303] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eee25a0e-a423-45cd-80e8-327029ae7dc4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.121373] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eee25a0e-a423-45cd-80e8-327029ae7dc4',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.122101] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20940711-36df-48c2-b8ae-df2cfecaebc8 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.123191] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20940711-36df-48c2-b8ae-df2cfecaebc8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.123191] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20940711-36df-48c2-b8ae-df2cfecaebc8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.123191] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20940711-36df-48c2-b8ae-df2cfecaebc8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.123191] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20940711-36df-48c2-b8ae-df2cfecaebc8',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.123321] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.123366] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.123530] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.123582] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.123627] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ba3a620-9fd8-44d2-8d21-20dfc5b1648d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.124638] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f946d66-543a-40be-9347-81d7eb4f4e31 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.124742] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.124853] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.124940] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.125046] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f946d66-543a-40be-9347-81d7eb4f4e31',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.125798] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d52cf5b6-2860-4667-8ade-9e0529358ed1 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.125912] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.125980] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.126143] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.126219] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d52cf5b6-2860-4667-8ade-9e0529358ed1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.127180] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78caaaf6-868f-4043-93dd-d9a75a05d023 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.127180] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.127180] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.127394] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.127394] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78caaaf6-868f-4043-93dd-d9a75a05d023',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.128041] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5387ebf9-b56f-4308-969a-3aa715cad9da taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.128129] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5387ebf9-b56f-4308-969a-3aa715cad9da" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.128188] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5387ebf9-b56f-4308-969a-3aa715cad9da" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.128369] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5387ebf9-b56f-4308-969a-3aa715cad9da" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.128415] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5387ebf9-b56f-4308-969a-3aa715cad9da',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.129186] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64557eb9-9b83-42ab-99e4-278f5711a22e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.129288] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.129351] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.129504] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.129570] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64557eb9-9b83-42ab-99e4-278f5711a22e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.130683] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a27cb9c-bb13-44cb-a531-49610a94a36e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.131017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.131017] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.131156] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.131156] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a27cb9c-bb13-44cb-a531-49610a94a36e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.131887] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.131999] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.132528] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.132528] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.132528] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('479009cc-bfe1-4ddc-a0f7-70c7b96b33dc',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.133363] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b50d66d8-0bc1-42fe-b025-b6e5287fc3df taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.133469] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b50d66d8-0bc1-42fe-b025-b6e5287fc3df" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.133530] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b50d66d8-0bc1-42fe-b025-b6e5287fc3df" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.133708] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b50d66d8-0bc1-42fe-b025-b6e5287fc3df" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.133756] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b50d66d8-0bc1-42fe-b025-b6e5287fc3df',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.134789] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a071d7d-92f1-4559-8dc2-314d4f1776fe taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.134882] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a071d7d-92f1-4559-8dc2-314d4f1776fe" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.134882] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a071d7d-92f1-4559-8dc2-314d4f1776fe" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.136033] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a071d7d-92f1-4559-8dc2-314d4f1776fe" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.136033] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a071d7d-92f1-4559-8dc2-314d4f1776fe',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.136033] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-706a5462-e893-428d-beb2-737cbec00439 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.136033] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.136033] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.136311] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.136311] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('706a5462-e893-428d-beb2-737cbec00439',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.136979] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c29a3314-8167-42dc-9e04-3dc4cb967960 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.136979] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c29a3314-8167-42dc-9e04-3dc4cb967960" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.137128] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c29a3314-8167-42dc-9e04-3dc4cb967960" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.137184] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c29a3314-8167-42dc-9e04-3dc4cb967960" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.137237] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c29a3314-8167-42dc-9e04-3dc4cb967960',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.138300] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28204c48-8cc9-4a78-9ae1-cbf9a28e9016 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.138423] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.138482] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.138713] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.138776] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28204c48-8cc9-4a78-9ae1-cbf9a28e9016',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.139436] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.139569] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.139634] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.139777] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.139839] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d9ed455-9c3f-46b7-9453-8a5f9cfb0580',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.140132] env[69506]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 1344.160619] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.160761] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.160832] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.161031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.210054] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.210054] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fca9cd47-c1fb-4023-8f12-fa1b22a98fd8 is going to be deleted. [ 1344.269017] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.269384] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.269384] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.269453] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.269537] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.272284] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fca9cd47-c1fb-4023-8f12-fa1b22a98fd8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.362270] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-258 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.362521] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-258" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.362682] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-258" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.362977] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-258" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.363295] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.363509] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.363663] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.363918] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.364136] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.364403] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1344.364548] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1344.364706] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1344.364832] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1344.364984] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1344.365141] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1344.365310] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1344.392361] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1344.392599] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1344.392813] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1344.393073] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-258" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.393426] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-8662e171-5c94-42f0-ad04-2d6039e32ab5 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.393609] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-8662e171-5c94-42f0-ad04-2d6039e32ab5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.393742] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-8662e171-5c94-42f0-ad04-2d6039e32ab5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.394137] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-8662e171-5c94-42f0-ad04-2d6039e32ab5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.394297] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8662e171-5c94-42f0-ad04-2d6039e32ab5',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.616254] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.616424] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.616424] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.616629] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.616720] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.616911] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.617028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.617093] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.617247] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.617322] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.617405] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 already deleted. [ 1344.617484] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.634810] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.634952] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.634995] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.635175] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.641439] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-28204c48-8cc9-4a78-9ae1-cbf9a28e9016 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.641544] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.641607] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.641782] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.641927] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.642036] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.642099] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.642239] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.642318] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.642400] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.642486] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('28204c48-8cc9-4a78-9ae1-cbf9a28e9016',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.666031] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.666143] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d91620e4-b545-4104-a2d6-4f8e42eac0c0 is going to be deleted. [ 1344.698540] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.698695] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.698741] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.698940] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.700447] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.700550] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.701246] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.701346] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.703424] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.703516] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.712308] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.712418] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.713114] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.713218] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.713883] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.713978] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.714690] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.714788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.715807] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.716016] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.716712] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.716807] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.717472] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.717568] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.718175] env[69506]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1344.718588] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.718682] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.720340] env[69506]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1344.720340] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.720340] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.720554] env[69506]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1344.720797] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.720886] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.721482] env[69506]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1344.721865] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.721972] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.722581] env[69506]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1344.722958] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.723064] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.723869] env[69506]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1344.724279] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.724374] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.725173] env[69506]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1344.725368] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.725479] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a27cb9c-bb13-44cb-a531-49610a94a36e is going to be deleted. [ 1344.726303] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.726483] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.750204] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.750312] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c29a3314-8167-42dc-9e04-3dc4cb967960 is going to be deleted. [ 1344.751123] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.751323] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.765476] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.765589] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.768264] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.768386] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5387ebf9-b56f-4308-969a-3aa715cad9da is going to be deleted. [ 1344.769145] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.769343] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.785521] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.785633] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64557eb9-9b83-42ab-99e4-278f5711a22e is going to be deleted. [ 1344.786337] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.786546] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.788782] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.788893] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.807576] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.807682] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.811153] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.811262] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 479009cc-bfe1-4ddc-a0f7-70c7b96b33dc is going to be deleted. [ 1344.811978] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.812188] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.858785] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.858895] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a071d7d-92f1-4559-8dc2-314d4f1776fe is going to be deleted. [ 1344.859645] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.859836] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.866778] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.866891] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.876418] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.876522] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.896730] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.896920] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.897053] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.897365] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.897526] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.898083] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 8662e171-5c94-42f0-ad04-2d6039e32ab5 not found, creating... [ 1344.898083] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.898268] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.898350] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.898588] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.898736] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.899062] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.899248] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.899374] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.899608] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.899757] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.899916] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 8662e171-5c94-42f0-ad04-2d6039e32ab5 is going to be created. [ 1344.913580] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.913704] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.917377] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.917503] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ba3a620-9fd8-44d2-8d21-20dfc5b1648d is going to be deleted. [ 1344.918387] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.918526] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.954029] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.954029] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.954029] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.954029] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.954352] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.954495] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-8662e171-5c94-42f0-ad04-2d6039e32ab5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.960598] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.960710] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d52cf5b6-2860-4667-8ade-9e0529358ed1 is going to be deleted. [ 1344.961565] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.961746] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.007322] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.007460] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.025514] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.025645] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20940711-36df-48c2-b8ae-df2cfecaebc8 is going to be deleted. [ 1345.026493] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.026694] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.078071] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.078281] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.100900] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.101077] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.133418] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.133518] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d9ed455-9c3f-46b7-9453-8a5f9cfb0580 is going to be deleted. [ 1345.134390] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.134599] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.149165] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('28204c48-8cc9-4a78-9ae1-cbf9a28e9016',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.179289] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.179428] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 96b2c90a-a7a0-4dcb-8212-5e459d8d4793 is going to be deleted. [ 1345.180208] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.180408] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.225667] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.225813] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0461c6a-1d2b-401e-b59f-af6eda84b6ca is going to be deleted. [ 1345.226593] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.226800] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.228101] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.228211] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.229104] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.229193] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.286521] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.286859] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f946d66-543a-40be-9347-81d7eb4f4e31 is going to be deleted. [ 1345.287473] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.287681] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.322766] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.322881] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.323726] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.323846] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b50d66d8-0bc1-42fe-b025-b6e5287fc3df is going to be deleted. [ 1345.324737] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.324926] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.370387] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.370480] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eee25a0e-a423-45cd-80e8-327029ae7dc4 is going to be deleted. [ 1345.371300] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.371509] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.399604] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.399733] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.418136] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.418256] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.435565] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.435691] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78caaaf6-868f-4043-93dd-d9a75a05d023 is going to be deleted. [ 1345.436618] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.436819] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.451170] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.451287] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.471309] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.471456] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 706a5462-e893-428d-beb2-737cbec00439 is going to be deleted. [ 1345.472337] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.472548] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.472638] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.472764] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d91620e4-b545-4104-a2d6-4f8e42eac0c0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.472919] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.473085] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.473165] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.473638] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a27cb9c-bb13-44cb-a531-49610a94a36e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.475627] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.475627] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.475627] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.475627] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.475627] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.475937] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eee25a0e-a423-45cd-80e8-327029ae7dc4" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.476077] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.476237] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.476320] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.476449] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c29a3314-8167-42dc-9e04-3dc4cb967960" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.476674] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.476674] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.476776] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.477018] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5387ebf9-b56f-4308-969a-3aa715cad9da" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.477018] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.477123] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.477788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.477788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64557eb9-9b83-42ab-99e4-278f5711a22e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.477788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.477788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.477788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.477788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-479009cc-bfe1-4ddc-a0f7-70c7b96b33dc" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.477788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.478102] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.478102] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.478359] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a071d7d-92f1-4559-8dc2-314d4f1776fe" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.478403] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.479763] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.479763] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.479763] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ba3a620-9fd8-44d2-8d21-20dfc5b1648d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.479763] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.479763] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.479763] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.479763] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d52cf5b6-2860-4667-8ade-9e0529358ed1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.479763] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.479763] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.480210] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.480210] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d9ed455-9c3f-46b7-9453-8a5f9cfb0580" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.480210] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.480210] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.480210] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.480353] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20940711-36df-48c2-b8ae-df2cfecaebc8" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.480604] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.480604] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.480672] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.480996] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-96b2c90a-a7a0-4dcb-8212-5e459d8d4793" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.481160] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.481306] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.481482] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.481655] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0461c6a-1d2b-401e-b59f-af6eda84b6ca" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.481775] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.481915] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.482051] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.482095] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b50d66d8-0bc1-42fe-b025-b6e5287fc3df" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.482226] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.482370] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.482443] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.482548] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f946d66-543a-40be-9347-81d7eb4f4e31" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.594675] env[69506]: INFO networking_nsxv3.common.synchronization [req-21d52a17-d54e-4c10-9f9c-8524b5a67757 req-8b82d67a-f2e5-4cb4-9639-babf18d16d1c service nova] Enqueued Resource ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 with Priority: HIGHEST for action security_group_rules [ 1345.594871] env[69506]: INFO networking_nsxv3.common.synchronization [req-21d52a17-d54e-4c10-9f9c-8524b5a67757 req-8b82d67a-f2e5-4cb4-9639-babf18d16d1c service nova] Enqueued Resource ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 with Priority: HIGHEST for action security_group_members [ 1345.595007] env[69506]: INFO networking_nsxv3.common.synchronization [req-21d52a17-d54e-4c10-9f9c-8524b5a67757 req-8b82d67a-f2e5-4cb4-9639-babf18d16d1c service nova] Enqueued Resource ID: 8662e171-5c94-42f0-ad04-2d6039e32ab5 with Priority: HIGHEST for action port [ 1345.595905] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.596203] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.596288] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.596519] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.596645] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.596796] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78caaaf6-868f-4043-93dd-d9a75a05d023" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.596995] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 with Priority: HIGHEST for action security_group_rules [ 1345.597165] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 with Priority: HIGHEST for action security_group_members [ 1345.597316] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8662e171-5c94-42f0-ad04-2d6039e32ab5 with Priority: HIGHEST for action port [ 1345.597874] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.598034] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.598134] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.598563] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.598563] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ec4d2c8-aabb-404a-9e02-8eef8990ffe0',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.599587] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.599697] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.599778] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.600153] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.600313] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.600445] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.600623] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.600739] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.600847] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.600959] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ec4d2c8-aabb-404a-9e02-8eef8990ffe0',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.601884] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-8662e171-5c94-42f0-ad04-2d6039e32ab5 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.602475] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8662e171-5c94-42f0-ad04-2d6039e32ab5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.602475] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8662e171-5c94-42f0-ad04-2d6039e32ab5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.602475] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8662e171-5c94-42f0-ad04-2d6039e32ab5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.602475] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8662e171-5c94-42f0-ad04-2d6039e32ab5',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.608660] env[69506]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1345.609316] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.609443] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.609513] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.609703] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.609789] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.609898] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-706a5462-e893-428d-beb2-737cbec00439" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.650903] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 28204c48-8cc9-4a78-9ae1-cbf9a28e9016: rpc.has_security_group_logging(os_id): False [ 1345.683308] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.683471] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.683579] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.683809] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.728960] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.729293] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.729408] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.729474] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.729672] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.729760] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.729855] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28204c48-8cc9-4a78-9ae1-cbf9a28e9016 is going to be updated. [ 1345.805604] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.805935] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.805935] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.806052] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.806170] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.822395] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28204c48-8cc9-4a78-9ae1-cbf9a28e9016 in Status: IN_PROGRESS for 2s [ 1346.105578] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5ec4d2c8-aabb-404a-9e02-8eef8990ffe0',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.105578] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.105578] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.105578] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8662e171-5c94-42f0-ad04-2d6039e32ab5 with status ACTIVE [ 1346.105578] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.105578] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.105578] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.107743] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.107743] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.107743] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.107743] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.107743] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.107743] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.107743] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.107743] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.107743] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.107743] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.107743] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.107743] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.107743] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8662e171-5c94-42f0-ad04-2d6039e32ab5 is going to be updated. [ 1346.129351] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.129351] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.129351] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.129612] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.130564] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.130564] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8662e171-5c94-42f0-ad04-2d6039e32ab5" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.612017] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5ec4d2c8-aabb-404a-9e02-8eef8990ffe0',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.112289] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.112468] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.112542] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.112755] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.112847] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.112950] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 is going to be created. [ 1347.136174] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.136316] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.136419] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.136590] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.136745] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.145967] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 in Status: UNINITIALIZED for 2s [ 1347.834786] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28204c48-8cc9-4a78-9ae1-cbf9a28e9016 in Status: SUCCESS [ 1347.835185] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.157137] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 in Status: SUCCESS [ 1349.157137] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.157137] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.157137] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.157137] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.157137] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.157137] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.157137] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.157137] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.157137] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.157137] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5ec4d2c8-aabb-404a-9e02-8eef8990ffe0',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.317024] env[69506]: INFO networking_nsxv3.common.synchronization [None req-1b90ad2a-811f-432f-b7c5-1d79093396ce None None] Enqueued Resource ID: ec4ebafb-83c1-42a7-953b-eb694ae4ce9b with Priority: HIGHEST for action port [ 1349.317024] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec4ebafb-83c1-42a7-953b-eb694ae4ce9b with Priority: HIGHEST for action port [ 1349.317024] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec4ebafb-83c1-42a7-953b-eb694ae4ce9b taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.317024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec4ebafb-83c1-42a7-953b-eb694ae4ce9b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.317024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec4ebafb-83c1-42a7-953b-eb694ae4ce9b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.317024] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec4ebafb-83c1-42a7-953b-eb694ae4ce9b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.317024] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec4ebafb-83c1-42a7-953b-eb694ae4ce9b',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.659305] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.659539] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.659640] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.659898] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.660216] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.660216] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.660381] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.660381] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.660506] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.660626] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.660794] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.660894] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.660978] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.661170] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.661310] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.661402] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.661458] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.661587] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.661740] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.661814] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.661887] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5ec4d2c8-aabb-404a-9e02-8eef8990ffe0',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.671463] env[69506]: INFO networking_nsxv3.common.synchronization [None req-819882aa-c01c-4a5a-9d55-71b0cfa2dc2f tempest-AttachVolumeShelveTestJSON-1092512781 tempest-AttachVolumeShelveTestJSON-1092512781-project-member] Enqueued Resource ID: 7f323bfa-211c-48db-8a5d-14eddfc45c66 with Priority: HIGHEST for action security_group_rules [ 1349.672590] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f323bfa-211c-48db-8a5d-14eddfc45c66 with Priority: HIGHEST for action security_group_rules [ 1349.672839] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f323bfa-211c-48db-8a5d-14eddfc45c66 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.673040] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.673092] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.673343] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.673427] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f323bfa-211c-48db-8a5d-14eddfc45c66',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.756654] env[69506]: INFO networking_nsxv3.common.synchronization [None req-efe6d9b2-97af-4e20-bfad-639db7046d90 tempest-AttachVolumeShelveTestJSON-1092512781 tempest-AttachVolumeShelveTestJSON-1092512781-project-member] Enqueued Resource ID: 7f323bfa-211c-48db-8a5d-14eddfc45c66 with Priority: HIGHEST for action security_group_rules [ 1349.757646] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f323bfa-211c-48db-8a5d-14eddfc45c66 with Priority: HIGHEST for action security_group_rules [ 1349.757646] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f323bfa-211c-48db-8a5d-14eddfc45c66 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.757646] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.819242] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ec4ebafb-83c1-42a7-953b-eb694ae4ce9b [ 1349.820060] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.820060] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.820060] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.820060] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.820060] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.820339] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ec4ebafb-83c1-42a7-953b-eb694ae4ce9b already deleted. [ 1349.820339] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec4ebafb-83c1-42a7-953b-eb694ae4ce9b" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.165306] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0: rpc.has_security_group_logging(os_id): False [ 1350.182656] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.182806] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.182878] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.183099] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.183194] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.183409] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.183510] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.183574] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.183733] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.183852] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.183986] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.184089] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.184162] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.184318] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.184673] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.184904] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.185009] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.185079] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.185405] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.185405] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.185405] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 is going to be created. [ 1350.189740] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.189850] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.189918] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.190088] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.190181] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.190270] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f323bfa-211c-48db-8a5d-14eddfc45c66 already deleted. [ 1350.190354] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.190493] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.190636] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.190718] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f323bfa-211c-48db-8a5d-14eddfc45c66',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.239464] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.239652] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.239694] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.239881] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.240072] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.251536] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 in Status: IN_PROGRESS for 2s [ 1350.711017] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.711206] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.711206] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.711454] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.711590] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.711696] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f323bfa-211c-48db-8a5d-14eddfc45c66 already deleted. [ 1350.711745] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.171504] env[69506]: INFO networking_nsxv3.common.synchronization [None req-c2959fe1-bd41-4d7c-81d8-de3cf3b4e320 None None] Enqueued Resource ID: 16c505d6-06e8-4edf-b4e2-3aed02aa0ef1 with Priority: HIGHEST for action port [ 1351.171769] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16c505d6-06e8-4edf-b4e2-3aed02aa0ef1 with Priority: HIGHEST for action port [ 1351.172540] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-16c505d6-06e8-4edf-b4e2-3aed02aa0ef1 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.172693] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16c505d6-06e8-4edf-b4e2-3aed02aa0ef1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.172786] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16c505d6-06e8-4edf-b4e2-3aed02aa0ef1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.173086] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16c505d6-06e8-4edf-b4e2-3aed02aa0ef1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.173198] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16c505d6-06e8-4edf-b4e2-3aed02aa0ef1',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.675205] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 16c505d6-06e8-4edf-b4e2-3aed02aa0ef1 [ 1351.675461] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.675594] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.675665] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.675865] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.675955] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.676062] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:16c505d6-06e8-4edf-b4e2-3aed02aa0ef1 already deleted. [ 1351.676143] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16c505d6-06e8-4edf-b4e2-3aed02aa0ef1" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.264792] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 in Status: SUCCESS [ 1352.265128] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.989103] env[69506]: INFO networking_nsxv3.common.synchronization [req-57b2ed0d-4e3d-41e0-8eef-de89a724db2c req-43503581-a974-4126-af0f-4deca87818b1 tempest-AttachVolumeShelveTestJSON-1092512781 tempest-AttachVolumeShelveTestJSON-1092512781-project-member] Enqueued Resource ID: 7f323bfa-211c-48db-8a5d-14eddfc45c66 with Priority: HIGHEST for action security_group_members [ 1354.989103] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f323bfa-211c-48db-8a5d-14eddfc45c66 with Priority: HIGHEST for action security_group_members [ 1354.989103] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f323bfa-211c-48db-8a5d-14eddfc45c66 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.989847] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.990097] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.990496] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.990878] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.991172] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.991364] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.991639] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.991856] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.992916] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f323bfa-211c-48db-8a5d-14eddfc45c66',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.323030] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-38 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.323030] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-38" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.323030] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-38" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.323030] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-38" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.323404] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.323581] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.323778] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.324065] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.324303] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.324585] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1355.324756] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1355.324884] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1355.325011] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1355.325199] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1355.325372] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1355.325545] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1355.335417] env[69506]: INFO networking_nsxv3.common.synchronization [req-3406f80d-5320-4423-98f2-e0708b724c7d req-617e940f-88f6-4d88-a338-2af56eee2413 tempest-AttachVolumeTestJSON-1082346606 tempest-AttachVolumeTestJSON-1082346606-project-member] Enqueued Resource ID: 28204c48-8cc9-4a78-9ae1-cbf9a28e9016 with Priority: HIGHEST for action security_group_members [ 1355.335663] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28204c48-8cc9-4a78-9ae1-cbf9a28e9016 with Priority: HIGHEST for action security_group_members [ 1355.336168] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-28204c48-8cc9-4a78-9ae1-cbf9a28e9016 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.336291] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.336367] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.336548] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.336703] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.336799] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.336878] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.336993] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.337092] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.337169] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28204c48-8cc9-4a78-9ae1-cbf9a28e9016',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.348822] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1355.348995] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1355.349186] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1355.349338] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-38" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.349654] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-6b37d3c1-e5c7-403c-bb00-0885dc72de06 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.349814] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-6b37d3c1-e5c7-403c-bb00-0885dc72de06" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.349944] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-6b37d3c1-e5c7-403c-bb00-0885dc72de06" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.350288] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-6b37d3c1-e5c7-403c-bb00-0885dc72de06" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.350476] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b37d3c1-e5c7-403c-bb00-0885dc72de06',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.494505] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.494664] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.494738] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.494956] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.495062] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.495290] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.495388] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.495452] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.495606] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.495684] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.495770] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f323bfa-211c-48db-8a5d-14eddfc45c66 already deleted. [ 1355.495850] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.839769] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.839915] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.839986] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.840230] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.840325] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.840523] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.840623] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.840685] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.840840] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.840918] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.841012] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28204c48-8cc9-4a78-9ae1-cbf9a28e9016 is going to be updated. [ 1355.852250] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.852427] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.852557] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.852781] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.852929] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.853093] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 6b37d3c1-e5c7-403c-bb00-0885dc72de06 not found, creating... [ 1355.853351] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.853513] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.853634] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.853843] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.853983] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.854302] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.854468] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.854590] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.854798] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.854937] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.855092] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 6b37d3c1-e5c7-403c-bb00-0885dc72de06 is going to be created. [ 1355.866908] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.867033] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.867098] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.867245] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.867407] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.873887] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28204c48-8cc9-4a78-9ae1-cbf9a28e9016 in Status: IN_PROGRESS for 2s [ 1355.875848] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.876030] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.876162] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.876418] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.876594] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.876796] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-6b37d3c1-e5c7-403c-bb00-0885dc72de06" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.593268] env[69506]: INFO networking_nsxv3.common.synchronization [req-57b2ed0d-4e3d-41e0-8eef-de89a724db2c req-6efbd867-655f-40b6-863c-27c531b9adbc service nova] Enqueued Resource ID: 7f323bfa-211c-48db-8a5d-14eddfc45c66 with Priority: HIGHEST for action security_group_rules [ 1356.593519] env[69506]: INFO networking_nsxv3.common.synchronization [req-57b2ed0d-4e3d-41e0-8eef-de89a724db2c req-6efbd867-655f-40b6-863c-27c531b9adbc service nova] Enqueued Resource ID: 7f323bfa-211c-48db-8a5d-14eddfc45c66 with Priority: HIGHEST for action security_group_members [ 1356.593612] env[69506]: INFO networking_nsxv3.common.synchronization [req-57b2ed0d-4e3d-41e0-8eef-de89a724db2c req-6efbd867-655f-40b6-863c-27c531b9adbc service nova] Enqueued Resource ID: 6b37d3c1-e5c7-403c-bb00-0885dc72de06 with Priority: HIGHEST for action port [ 1356.593845] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f323bfa-211c-48db-8a5d-14eddfc45c66 with Priority: HIGHEST for action security_group_rules [ 1356.593974] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f323bfa-211c-48db-8a5d-14eddfc45c66 with Priority: HIGHEST for action security_group_members [ 1356.594083] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b37d3c1-e5c7-403c-bb00-0885dc72de06 with Priority: HIGHEST for action port [ 1356.594640] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f323bfa-211c-48db-8a5d-14eddfc45c66 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.594765] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.594833] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.595049] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.595118] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f323bfa-211c-48db-8a5d-14eddfc45c66',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.595967] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f323bfa-211c-48db-8a5d-14eddfc45c66 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.596055] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.596154] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.596567] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.596567] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.596567] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.596567] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.596965] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.596965] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.596965] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f323bfa-211c-48db-8a5d-14eddfc45c66',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.597523] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b37d3c1-e5c7-403c-bb00-0885dc72de06 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.597629] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b37d3c1-e5c7-403c-bb00-0885dc72de06" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.597696] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b37d3c1-e5c7-403c-bb00-0885dc72de06" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.597842] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b37d3c1-e5c7-403c-bb00-0885dc72de06" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.597915] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b37d3c1-e5c7-403c-bb00-0885dc72de06',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1357.100277] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f323bfa-211c-48db-8a5d-14eddfc45c66 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.100496] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.100586] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f323bfa-211c-48db-8a5d-14eddfc45c66',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1357.101500] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6b37d3c1-e5c7-403c-bb00-0885dc72de06 with status ACTIVE [ 1357.101678] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.101791] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.101856] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.104044] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.104044] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.104044] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.104044] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.104044] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.104044] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.104044] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.104044] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.104044] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.104044] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.104044] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.104044] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.104044] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6b37d3c1-e5c7-403c-bb00-0885dc72de06 is going to be updated. [ 1357.122620] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.122799] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.122896] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.123120] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.123286] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.123481] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b37d3c1-e5c7-403c-bb00-0885dc72de06" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.605616] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f323bfa-211c-48db-8a5d-14eddfc45c66',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1357.883023] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28204c48-8cc9-4a78-9ae1-cbf9a28e9016 in Status: SUCCESS [ 1357.883023] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28204c48-8cc9-4a78-9ae1-cbf9a28e9016 deletion is rescheduled due to dependency. [ 1357.883023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.108050] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.108212] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.108212] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.108404] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.108497] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.108603] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f323bfa-211c-48db-8a5d-14eddfc45c66 is going to be created. [ 1358.130025] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.130177] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.130177] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.130297] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.130447] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.138240] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f323bfa-211c-48db-8a5d-14eddfc45c66 in Status: UNINITIALIZED for 2s [ 1359.955547] env[69506]: INFO networking_nsxv3.common.synchronization [None req-5def6f6f-39ce-44fc-8366-6dc67dea75c1 tempest-AttachVolumeTestJSON-1082346606 tempest-AttachVolumeTestJSON-1082346606-project-member] Enqueued Resource ID: e583692f-de45-4011-b07f-87e665a77040 with Priority: HIGHEST for action security_group_rules [ 1359.956112] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e583692f-de45-4011-b07f-87e665a77040 with Priority: HIGHEST for action security_group_rules [ 1359.956419] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e583692f-de45-4011-b07f-87e665a77040 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.956531] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e583692f-de45-4011-b07f-87e665a77040" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.956596] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e583692f-de45-4011-b07f-87e665a77040" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.956841] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e583692f-de45-4011-b07f-87e665a77040" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.956918] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e583692f-de45-4011-b07f-87e665a77040',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.042657] env[69506]: INFO networking_nsxv3.common.synchronization [None req-996bc239-7594-48b9-a073-ff4d18e7db7a tempest-AttachVolumeTestJSON-1082346606 tempest-AttachVolumeTestJSON-1082346606-project-member] Enqueued Resource ID: e583692f-de45-4011-b07f-87e665a77040 with Priority: HIGHEST for action security_group_rules [ 1360.043235] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e583692f-de45-4011-b07f-87e665a77040 with Priority: HIGHEST for action security_group_rules [ 1360.043564] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e583692f-de45-4011-b07f-87e665a77040 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.043681] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e583692f-de45-4011-b07f-87e665a77040" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.148293] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f323bfa-211c-48db-8a5d-14eddfc45c66 in Status: SUCCESS [ 1360.148511] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.148671] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.148888] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.149095] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.149210] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.149383] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.149492] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.149605] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.149696] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.149785] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7f323bfa-211c-48db-8a5d-14eddfc45c66',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.476680] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.476884] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.476981] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.477263] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.477369] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.477491] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e583692f-de45-4011-b07f-87e665a77040 already deleted. [ 1360.477598] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e583692f-de45-4011-b07f-87e665a77040" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.477780] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e583692f-de45-4011-b07f-87e665a77040" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.477976] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e583692f-de45-4011-b07f-87e665a77040" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.478082] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e583692f-de45-4011-b07f-87e665a77040',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.651992] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7f323bfa-211c-48db-8a5d-14eddfc45c66',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.997646] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.997646] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.997646] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.997646] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.997646] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.997646] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e583692f-de45-4011-b07f-87e665a77040 already deleted. [ 1360.998196] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e583692f-de45-4011-b07f-87e665a77040" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.156701] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7f323bfa-211c-48db-8a5d-14eddfc45c66: rpc.has_security_group_logging(os_id): False [ 1361.172809] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.172973] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.173059] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.173234] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.173328] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.173568] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.174141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.174141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.174141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.174141] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.174141] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f323bfa-211c-48db-8a5d-14eddfc45c66 is going to be created. [ 1361.236586] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.236709] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.236846] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.236917] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.237101] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.247043] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f323bfa-211c-48db-8a5d-14eddfc45c66 in Status: IN_PROGRESS for 2s [ 1363.259931] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f323bfa-211c-48db-8a5d-14eddfc45c66 in Status: SUCCESS [ 1363.260353] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.044015] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1365.044325] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1365.276652] env[69506]: INFO networking_nsxv3.common.synchronization [req-bc7da6ac-eb26-4419-88dc-8cc91a79eecb req-00214720-2225-4008-b83a-d06f61f87994 tempest-AttachVolumeTestJSON-1082346606 tempest-AttachVolumeTestJSON-1082346606-project-member] Enqueued Resource ID: e583692f-de45-4011-b07f-87e665a77040 with Priority: HIGHEST for action security_group_members [ 1365.277221] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e583692f-de45-4011-b07f-87e665a77040 with Priority: HIGHEST for action security_group_members [ 1365.277544] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-e583692f-de45-4011-b07f-87e665a77040 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.277678] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e583692f-de45-4011-b07f-87e665a77040" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.277747] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e583692f-de45-4011-b07f-87e665a77040" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.278022] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e583692f-de45-4011-b07f-87e665a77040" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.278264] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.278378] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.278437] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.278603] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.278717] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.278819] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e583692f-de45-4011-b07f-87e665a77040',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.573401] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-211 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.573656] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-211" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.573753] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-211" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.574022] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-211" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.574301] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.574481] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.574793] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.575038] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.575194] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.575416] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1365.575848] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1365.575982] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1365.576185] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1365.576255] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1365.576348] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1365.576499] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1365.596485] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1365.596688] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1365.596786] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1365.596960] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-211" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.597291] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-4facfb63-eded-4a6c-8569-0d3ab6c0fdc7 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.597471] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-4facfb63-eded-4a6c-8569-0d3ab6c0fdc7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.597596] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-4facfb63-eded-4a6c-8569-0d3ab6c0fdc7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.597927] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-4facfb63-eded-4a6c-8569-0d3ab6c0fdc7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.598086] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4facfb63-eded-4a6c-8569-0d3ab6c0fdc7',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.783960] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.784224] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.784224] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.784443] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.784545] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.784743] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.784843] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.784906] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.785073] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.785150] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.785259] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e583692f-de45-4011-b07f-87e665a77040 already deleted. [ 1365.785331] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e583692f-de45-4011-b07f-87e665a77040" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.100387] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.100791] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.100791] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.100975] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.101153] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.101320] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 4facfb63-eded-4a6c-8569-0d3ab6c0fdc7 not found, creating... [ 1366.101601] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.101765] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.101889] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.102142] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.102339] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.102639] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.102823] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.102950] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.103192] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.103338] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.103485] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 4facfb63-eded-4a6c-8569-0d3ab6c0fdc7 is going to be created. [ 1366.122407] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.122597] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.122708] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.122951] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.123195] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.123416] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-4facfb63-eded-4a6c-8569-0d3ab6c0fdc7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.832795] env[69506]: INFO networking_nsxv3.common.synchronization [req-bc7da6ac-eb26-4419-88dc-8cc91a79eecb req-9ff87c43-107c-4cbf-a10e-39d512db351f service nova] Enqueued Resource ID: e583692f-de45-4011-b07f-87e665a77040 with Priority: HIGHEST for action security_group_rules [ 1366.832878] env[69506]: INFO networking_nsxv3.common.synchronization [req-bc7da6ac-eb26-4419-88dc-8cc91a79eecb req-9ff87c43-107c-4cbf-a10e-39d512db351f service nova] Enqueued Resource ID: e583692f-de45-4011-b07f-87e665a77040 with Priority: HIGHEST for action security_group_members [ 1366.833032] env[69506]: INFO networking_nsxv3.common.synchronization [req-bc7da6ac-eb26-4419-88dc-8cc91a79eecb req-9ff87c43-107c-4cbf-a10e-39d512db351f service nova] Enqueued Resource ID: 4facfb63-eded-4a6c-8569-0d3ab6c0fdc7 with Priority: HIGHEST for action port [ 1366.833260] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e583692f-de45-4011-b07f-87e665a77040 with Priority: HIGHEST for action security_group_rules [ 1366.833393] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e583692f-de45-4011-b07f-87e665a77040 with Priority: HIGHEST for action security_group_members [ 1366.833493] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4facfb63-eded-4a6c-8569-0d3ab6c0fdc7 with Priority: HIGHEST for action port [ 1366.834160] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e583692f-de45-4011-b07f-87e665a77040 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.834283] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e583692f-de45-4011-b07f-87e665a77040" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.834360] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e583692f-de45-4011-b07f-87e665a77040" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.834581] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e583692f-de45-4011-b07f-87e665a77040" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.834642] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e583692f-de45-4011-b07f-87e665a77040',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.836016] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-e583692f-de45-4011-b07f-87e665a77040 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.836156] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e583692f-de45-4011-b07f-87e665a77040" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.836221] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e583692f-de45-4011-b07f-87e665a77040" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.836389] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e583692f-de45-4011-b07f-87e665a77040" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.836538] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.836713] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.836713] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.836820] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.836910] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.837008] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e583692f-de45-4011-b07f-87e665a77040',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.838198] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-4facfb63-eded-4a6c-8569-0d3ab6c0fdc7 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.838415] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4facfb63-eded-4a6c-8569-0d3ab6c0fdc7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.838499] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4facfb63-eded-4a6c-8569-0d3ab6c0fdc7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.838656] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4facfb63-eded-4a6c-8569-0d3ab6c0fdc7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.838733] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4facfb63-eded-4a6c-8569-0d3ab6c0fdc7',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.339204] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e583692f-de45-4011-b07f-87e665a77040',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.340244] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-e583692f-de45-4011-b07f-87e665a77040 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.340349] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e583692f-de45-4011-b07f-87e665a77040" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.340520] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4facfb63-eded-4a6c-8569-0d3ab6c0fdc7 with status ACTIVE [ 1367.340734] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.340824] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.340866] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.341084] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.341161] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.341345] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.341445] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.341507] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.341658] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.341735] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.341914] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.342016] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.342799] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.342960] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.343165] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.343269] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4facfb63-eded-4a6c-8569-0d3ab6c0fdc7 is going to be updated. [ 1367.364642] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.364851] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.364851] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.365108] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.365287] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.365463] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4facfb63-eded-4a6c-8569-0d3ab6c0fdc7" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.845451] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e583692f-de45-4011-b07f-87e665a77040',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.348369] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.348766] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.348766] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.348853] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.348889] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.349020] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e583692f-de45-4011-b07f-87e665a77040 is going to be created. [ 1368.370937] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.371094] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.371137] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.371298] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.371447] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.380823] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e583692f-de45-4011-b07f-87e665a77040 in Status: UNINITIALIZED for 2s [ 1369.923408] env[69506]: INFO networking_nsxv3.common.synchronization [req-0a82cdf7-bc61-43e8-9d00-9c24e5a4310f req-0deb383f-05d8-4330-a49f-54fca613e6b2 tempest-ServerActionsTestOtherA-1202948283 tempest-ServerActionsTestOtherA-1202948283-project-member] Enqueued Resource ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 with Priority: HIGHEST for action security_group_members [ 1369.923928] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 with Priority: HIGHEST for action security_group_members [ 1369.924275] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.924399] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.924452] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.924645] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.924802] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.924903] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.924968] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.925297] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.925393] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.925509] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ec4d2c8-aabb-404a-9e02-8eef8990ffe0',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.392061] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e583692f-de45-4011-b07f-87e665a77040 in Status: SUCCESS [ 1370.392061] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e583692f-de45-4011-b07f-87e665a77040" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.392061] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e583692f-de45-4011-b07f-87e665a77040" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.392285] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e583692f-de45-4011-b07f-87e665a77040" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.392403] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.392518] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.392576] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.392736] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.392818] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.392906] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e583692f-de45-4011-b07f-87e665a77040" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.393014] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e583692f-de45-4011-b07f-87e665a77040',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.427741] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.427906] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.427960] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.428161] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.428251] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.428445] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.428548] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.428597] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.428744] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.428818] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.428903] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 is going to be updated. [ 1370.454477] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.454477] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.454701] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.454701] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.454863] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.462065] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 in Status: IN_PROGRESS for 2s [ 1370.895604] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e583692f-de45-4011-b07f-87e665a77040',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1371.398462] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e583692f-de45-4011-b07f-87e665a77040: rpc.has_security_group_logging(os_id): False [ 1371.419846] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.420082] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.420200] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.420466] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.420555] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.420816] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.420923] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.420988] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.421155] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.421238] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.421320] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e583692f-de45-4011-b07f-87e665a77040 is going to be created. [ 1371.491074] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.491221] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.491306] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.491560] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.491767] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.506304] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e583692f-de45-4011-b07f-87e665a77040 in Status: IN_PROGRESS for 2s [ 1372.478108] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 in Status: SUCCESS [ 1372.478108] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 deletion is rescheduled due to dependency. [ 1372.478513] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.517620] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e583692f-de45-4011-b07f-87e665a77040 in Status: SUCCESS [ 1373.517620] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e583692f-de45-4011-b07f-87e665a77040" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.088883] env[69506]: INFO networking_nsxv3.common.synchronization [None req-69fce7e5-7196-488b-8b44-531f2d6c798a tempest-ServerActionsTestOtherA-1202948283 tempest-ServerActionsTestOtherA-1202948283-project-member] Enqueued Resource ID: c12eaa8a-f278-4d51-a697-9547755f428e with Priority: HIGHEST for action security_group_rules [ 1374.089518] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c12eaa8a-f278-4d51-a697-9547755f428e with Priority: HIGHEST for action security_group_rules [ 1374.089890] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c12eaa8a-f278-4d51-a697-9547755f428e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.090872] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c12eaa8a-f278-4d51-a697-9547755f428e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.091481] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c12eaa8a-f278-4d51-a697-9547755f428e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.091920] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c12eaa8a-f278-4d51-a697-9547755f428e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.092090] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c12eaa8a-f278-4d51-a697-9547755f428e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1374.181502] env[69506]: INFO networking_nsxv3.common.synchronization [None req-1346bc24-6d9c-431c-b5f2-9663a232b9ee tempest-ServerActionsTestOtherA-1202948283 tempest-ServerActionsTestOtherA-1202948283-project-member] Enqueued Resource ID: c12eaa8a-f278-4d51-a697-9547755f428e with Priority: HIGHEST for action security_group_rules [ 1374.181502] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c12eaa8a-f278-4d51-a697-9547755f428e with Priority: HIGHEST for action security_group_rules [ 1374.181502] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c12eaa8a-f278-4d51-a697-9547755f428e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.181502] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c12eaa8a-f278-4d51-a697-9547755f428e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.614158] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.614582] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.614582] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.614658] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.614756] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.614851] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c12eaa8a-f278-4d51-a697-9547755f428e already deleted. [ 1374.614936] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c12eaa8a-f278-4d51-a697-9547755f428e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.615099] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c12eaa8a-f278-4d51-a697-9547755f428e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.615250] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c12eaa8a-f278-4d51-a697-9547755f428e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.615348] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c12eaa8a-f278-4d51-a697-9547755f428e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1375.135028] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.135237] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.135352] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.135642] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.135779] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.135919] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c12eaa8a-f278-4d51-a697-9547755f428e already deleted. [ 1375.136057] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c12eaa8a-f278-4d51-a697-9547755f428e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.182612] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1379.182947] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1379.340649] env[69506]: INFO networking_nsxv3.common.synchronization [req-9036db07-3225-408c-8448-20e67acffc05 req-d2dfd4a7-381e-4ded-b449-d38579cc7ecb tempest-ServerActionsTestOtherA-1202948283 tempest-ServerActionsTestOtherA-1202948283-project-member] Enqueued Resource ID: c12eaa8a-f278-4d51-a697-9547755f428e with Priority: HIGHEST for action security_group_members [ 1379.341532] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c12eaa8a-f278-4d51-a697-9547755f428e with Priority: HIGHEST for action security_group_members [ 1379.341848] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-c12eaa8a-f278-4d51-a697-9547755f428e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.342020] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c12eaa8a-f278-4d51-a697-9547755f428e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.342115] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c12eaa8a-f278-4d51-a697-9547755f428e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.342285] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c12eaa8a-f278-4d51-a697-9547755f428e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.342457] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.342568] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.342630] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.342784] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.342870] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.342964] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c12eaa8a-f278-4d51-a697-9547755f428e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.586281] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-258 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.586480] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-258" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.586615] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-258" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.586890] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-258" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.587153] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.587315] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.587437] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.587651] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.587800] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.588017] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1379.588138] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1379.588253] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1379.588366] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1379.588480] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1379.588594] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1379.588728] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1379.607268] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1379.607427] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1379.607558] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1379.607727] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-258" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.608026] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-08a98f66-6e47-400c-a1ea-e6bbfb19675a taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.608205] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-08a98f66-6e47-400c-a1ea-e6bbfb19675a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.608330] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-08a98f66-6e47-400c-a1ea-e6bbfb19675a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.608624] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-08a98f66-6e47-400c-a1ea-e6bbfb19675a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.608767] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08a98f66-6e47-400c-a1ea-e6bbfb19675a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.844789] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.844946] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.845030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.845251] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.845343] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.845543] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.845643] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.845696] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.845834] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.845908] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.845992] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c12eaa8a-f278-4d51-a697-9547755f428e already deleted. [ 1379.846089] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c12eaa8a-f278-4d51-a697-9547755f428e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.111621] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.111911] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.112071] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.112365] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.112539] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.112705] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 08a98f66-6e47-400c-a1ea-e6bbfb19675a not found, creating... [ 1380.112969] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.113150] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.113267] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.113486] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.113627] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.113915] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.114088] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.114210] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.114430] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.114586] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.114734] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 08a98f66-6e47-400c-a1ea-e6bbfb19675a is going to be created. [ 1380.134992] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.135184] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.135286] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.135532] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.135750] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.135964] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-08a98f66-6e47-400c-a1ea-e6bbfb19675a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.816616] env[69506]: INFO networking_nsxv3.common.synchronization [req-9036db07-3225-408c-8448-20e67acffc05 req-53ffb137-4f00-4773-b544-9ea4af6869c8 service nova] Enqueued Resource ID: c12eaa8a-f278-4d51-a697-9547755f428e with Priority: HIGHEST for action security_group_rules [ 1380.816934] env[69506]: INFO networking_nsxv3.common.synchronization [req-9036db07-3225-408c-8448-20e67acffc05 req-53ffb137-4f00-4773-b544-9ea4af6869c8 service nova] Enqueued Resource ID: c12eaa8a-f278-4d51-a697-9547755f428e with Priority: HIGHEST for action security_group_members [ 1380.817009] env[69506]: INFO networking_nsxv3.common.synchronization [req-9036db07-3225-408c-8448-20e67acffc05 req-53ffb137-4f00-4773-b544-9ea4af6869c8 service nova] Enqueued Resource ID: 08a98f66-6e47-400c-a1ea-e6bbfb19675a with Priority: HIGHEST for action port [ 1380.817504] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c12eaa8a-f278-4d51-a697-9547755f428e with Priority: HIGHEST for action security_group_rules [ 1380.817666] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c12eaa8a-f278-4d51-a697-9547755f428e with Priority: HIGHEST for action security_group_members [ 1380.817730] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08a98f66-6e47-400c-a1ea-e6bbfb19675a with Priority: HIGHEST for action port [ 1380.817999] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c12eaa8a-f278-4d51-a697-9547755f428e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.818134] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c12eaa8a-f278-4d51-a697-9547755f428e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.818209] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c12eaa8a-f278-4d51-a697-9547755f428e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.818436] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c12eaa8a-f278-4d51-a697-9547755f428e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.818521] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c12eaa8a-f278-4d51-a697-9547755f428e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1380.819384] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-c12eaa8a-f278-4d51-a697-9547755f428e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.819492] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c12eaa8a-f278-4d51-a697-9547755f428e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.819565] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c12eaa8a-f278-4d51-a697-9547755f428e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.819763] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c12eaa8a-f278-4d51-a697-9547755f428e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.819914] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.820015] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.820127] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.820220] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.820303] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.820389] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c12eaa8a-f278-4d51-a697-9547755f428e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1380.821405] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-08a98f66-6e47-400c-a1ea-e6bbfb19675a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.821513] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08a98f66-6e47-400c-a1ea-e6bbfb19675a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.821629] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08a98f66-6e47-400c-a1ea-e6bbfb19675a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.821722] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08a98f66-6e47-400c-a1ea-e6bbfb19675a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.821801] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08a98f66-6e47-400c-a1ea-e6bbfb19675a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1381.323816] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-c12eaa8a-f278-4d51-a697-9547755f428e taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.323947] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c12eaa8a-f278-4d51-a697-9547755f428e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.324168] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c12eaa8a-f278-4d51-a697-9547755f428e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1381.325114] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 08a98f66-6e47-400c-a1ea-e6bbfb19675a with status ACTIVE [ 1381.325296] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.325430] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.325523] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.325722] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.325811] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.325984] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.326096] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.326159] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.326306] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.326387] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.326571] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.326665] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.326726] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.326867] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.326937] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.327055] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 08a98f66-6e47-400c-a1ea-e6bbfb19675a is going to be updated. [ 1381.346028] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.346170] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.346219] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.346384] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.346509] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.346662] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08a98f66-6e47-400c-a1ea-e6bbfb19675a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.829635] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c12eaa8a-f278-4d51-a697-9547755f428e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1382.331981] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.332193] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.332235] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.332446] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.332535] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.332634] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c12eaa8a-f278-4d51-a697-9547755f428e is going to be created. [ 1382.354712] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.354879] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.354921] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.355119] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.355272] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.365091] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c12eaa8a-f278-4d51-a697-9547755f428e in Status: UNINITIALIZED for 2s [ 1384.386610] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c12eaa8a-f278-4d51-a697-9547755f428e in Status: SUCCESS [ 1384.387030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c12eaa8a-f278-4d51-a697-9547755f428e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.387030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c12eaa8a-f278-4d51-a697-9547755f428e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.387150] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c12eaa8a-f278-4d51-a697-9547755f428e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.387329] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.387444] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.387508] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.387658] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.387738] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.387821] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c12eaa8a-f278-4d51-a697-9547755f428e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.387906] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c12eaa8a-f278-4d51-a697-9547755f428e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.890188] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c12eaa8a-f278-4d51-a697-9547755f428e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1385.392353] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c12eaa8a-f278-4d51-a697-9547755f428e: rpc.has_security_group_logging(os_id): False [ 1385.409263] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.409387] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.409460] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.409664] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.409758] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.409990] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.410104] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.410170] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.410320] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.410397] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.410484] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c12eaa8a-f278-4d51-a697-9547755f428e is going to be created. [ 1385.469085] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.469270] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.469270] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.469461] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.469632] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.479239] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c12eaa8a-f278-4d51-a697-9547755f428e in Status: IN_PROGRESS for 2s [ 1385.819271] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1385.819465] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1387.491880] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c12eaa8a-f278-4d51-a697-9547755f428e in Status: SUCCESS [ 1387.491880] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c12eaa8a-f278-4d51-a697-9547755f428e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.820631] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1390.820631] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1395.821829] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1395.821829] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1400.822645] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1400.822955] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1405.823703] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1405.824050] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1410.825399] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1410.825842] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1415.826621] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1415.826621] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1420.828020] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1420.828020] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1425.828521] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1425.828944] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1430.829436] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1430.829670] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1433.016888] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-38 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.017229] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-38" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.017285] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-38" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.017591] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-38" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.017865] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.018040] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.018166] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.018383] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.018538] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.018760] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1433.018878] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1433.018990] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1433.019115] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1433.019228] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1433.019336] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1433.019467] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1433.038846] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1433.038846] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1433.039019] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1433.039123] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-38" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.039441] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-6b37d3c1-e5c7-403c-bb00-0885dc72de06 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.039611] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-6b37d3c1-e5c7-403c-bb00-0885dc72de06" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.039755] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-6b37d3c1-e5c7-403c-bb00-0885dc72de06" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.040019] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-6b37d3c1-e5c7-403c-bb00-0885dc72de06" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.040181] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b37d3c1-e5c7-403c-bb00-0885dc72de06',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1433.543136] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.543370] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.543455] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.543732] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.543891] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.544212] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.544377] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.544502] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.544723] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.544867] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.545238] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.545402] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.545529] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.545742] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.545884] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.546068] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 6b37d3c1-e5c7-403c-bb00-0885dc72de06 is going to be updated. [ 1433.570948] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.571148] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.571287] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.571537] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.571729] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.571944] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-6b37d3c1-e5c7-403c-bb00-0885dc72de06" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.225762] env[69506]: INFO networking_nsxv3.common.synchronization [req-34578600-d154-4b9c-a3f8-a991aaf31f68 req-4c476c44-c1c7-4cc8-b12f-3d71d8d88f4e service nova] Enqueued Resource ID: 7f323bfa-211c-48db-8a5d-14eddfc45c66 with Priority: HIGHEST for action security_group_rules [ 1434.226040] env[69506]: INFO networking_nsxv3.common.synchronization [req-34578600-d154-4b9c-a3f8-a991aaf31f68 req-4c476c44-c1c7-4cc8-b12f-3d71d8d88f4e service nova] Enqueued Resource ID: 7f323bfa-211c-48db-8a5d-14eddfc45c66 with Priority: HIGHEST for action security_group_members [ 1434.226136] env[69506]: INFO networking_nsxv3.common.synchronization [req-34578600-d154-4b9c-a3f8-a991aaf31f68 req-4c476c44-c1c7-4cc8-b12f-3d71d8d88f4e service nova] Enqueued Resource ID: 6b37d3c1-e5c7-403c-bb00-0885dc72de06 with Priority: HIGHEST for action port [ 1434.226364] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f323bfa-211c-48db-8a5d-14eddfc45c66 with Priority: HIGHEST for action security_group_rules [ 1434.226495] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f323bfa-211c-48db-8a5d-14eddfc45c66 with Priority: HIGHEST for action security_group_members [ 1434.226589] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b37d3c1-e5c7-403c-bb00-0885dc72de06 with Priority: HIGHEST for action port [ 1434.228715] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f323bfa-211c-48db-8a5d-14eddfc45c66 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.228853] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.228927] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.229188] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.229321] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f323bfa-211c-48db-8a5d-14eddfc45c66',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1434.230460] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f323bfa-211c-48db-8a5d-14eddfc45c66 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.230823] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.230823] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.230823] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.230993] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.231074] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.231114] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.231243] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.231332] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.231438] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f323bfa-211c-48db-8a5d-14eddfc45c66',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1434.232191] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b37d3c1-e5c7-403c-bb00-0885dc72de06 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.232443] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b37d3c1-e5c7-403c-bb00-0885dc72de06" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.232443] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b37d3c1-e5c7-403c-bb00-0885dc72de06" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.232516] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b37d3c1-e5c7-403c-bb00-0885dc72de06" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.232578] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b37d3c1-e5c7-403c-bb00-0885dc72de06',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1434.734430] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f323bfa-211c-48db-8a5d-14eddfc45c66 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.734580] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.734717] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f323bfa-211c-48db-8a5d-14eddfc45c66',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1434.735647] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6b37d3c1-e5c7-403c-bb00-0885dc72de06 with status ACTIVE [ 1434.735823] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.735935] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.735995] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.736211] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.736294] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.736459] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.736553] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.736611] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.736754] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.736828] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.737010] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.737110] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.737174] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.737319] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.737384] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.737515] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6b37d3c1-e5c7-403c-bb00-0885dc72de06 is going to be updated. [ 1434.759402] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.759600] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.759600] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.759778] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.759870] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.760023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b37d3c1-e5c7-403c-bb00-0885dc72de06" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.239201] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f323bfa-211c-48db-8a5d-14eddfc45c66',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1435.741770] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.741955] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.741999] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.742234] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.742330] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.742437] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f323bfa-211c-48db-8a5d-14eddfc45c66 is going to be updated. [ 1435.774979] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.775221] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.775273] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.775453] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.775607] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.785559] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f323bfa-211c-48db-8a5d-14eddfc45c66 in Status: IN_PROGRESS for 2s [ 1437.797044] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f323bfa-211c-48db-8a5d-14eddfc45c66 in Status: SUCCESS [ 1437.797350] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.797461] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.797705] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.797914] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.798072] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.798188] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.798441] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.798569] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.798708] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.798851] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7f323bfa-211c-48db-8a5d-14eddfc45c66',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1438.301473] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7f323bfa-211c-48db-8a5d-14eddfc45c66',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1438.803893] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7f323bfa-211c-48db-8a5d-14eddfc45c66: rpc.has_security_group_logging(os_id): False [ 1438.822082] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.822305] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.822305] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.822536] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.822628] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.822876] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.822976] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.823075] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.823239] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.823318] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.823408] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f323bfa-211c-48db-8a5d-14eddfc45c66 is going to be updated. [ 1438.896460] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.896460] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.896835] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.896835] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.896913] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.909841] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f323bfa-211c-48db-8a5d-14eddfc45c66 in Status: IN_PROGRESS for 2s [ 1439.227839] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1439.228031] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1440.922628] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f323bfa-211c-48db-8a5d-14eddfc45c66 in Status: SUCCESS [ 1440.923044] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.050371] env[69506]: INFO networking_nsxv3.common.synchronization [req-d74545fc-46ae-4e9c-a94b-8a3a46998ca3 req-e0b1a1cc-2c09-4f19-82a7-8caec89ba87a tempest-AttachVolumeTestJSON-1082346606 tempest-AttachVolumeTestJSON-1082346606-project-member] Enqueued Resource ID: e583692f-de45-4011-b07f-87e665a77040 with Priority: HIGHEST for action security_group_members [ 1442.050902] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e583692f-de45-4011-b07f-87e665a77040 with Priority: HIGHEST for action security_group_members [ 1442.051733] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-e583692f-de45-4011-b07f-87e665a77040 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.051733] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e583692f-de45-4011-b07f-87e665a77040" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.051733] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e583692f-de45-4011-b07f-87e665a77040" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.051733] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e583692f-de45-4011-b07f-87e665a77040" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.051733] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.051985] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.051985] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.052067] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.052109] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.052196] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e583692f-de45-4011-b07f-87e665a77040',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1442.555997] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.556304] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.556443] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.556806] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.556806] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.556956] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.557159] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.557159] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.557344] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.557546] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.557656] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e583692f-de45-4011-b07f-87e665a77040 is going to be updated. [ 1442.589088] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.589292] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.589292] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.589527] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.589669] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.604189] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e583692f-de45-4011-b07f-87e665a77040 in Status: IN_PROGRESS for 2s [ 1444.615345] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e583692f-de45-4011-b07f-87e665a77040 in Status: SUCCESS [ 1444.615719] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e583692f-de45-4011-b07f-87e665a77040 deletion is rescheduled due to dependency. [ 1444.615719] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e583692f-de45-4011-b07f-87e665a77040" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.052496] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1447.052919] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1452.054289] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1452.054289] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1457.055376] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1457.055669] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1462.056409] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1462.056715] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1467.057564] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1467.057922] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1472.058519] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1472.058814] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1477.059676] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1477.060032] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1482.060873] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1482.061160] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1487.062241] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1487.062241] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1490.499283] env[69506]: INFO networking_nsxv3.common.synchronization [req-d532620d-14e2-4dfc-81bd-fc64c3b0e5e2 req-7c14b6fb-774f-4a77-b20d-39e20e818365 tempest-AttachVolumeShelveTestJSON-1092512781 tempest-AttachVolumeShelveTestJSON-1092512781-project-member] Enqueued Resource ID: 7f323bfa-211c-48db-8a5d-14eddfc45c66 with Priority: HIGHEST for action security_group_members [ 1490.499549] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f323bfa-211c-48db-8a5d-14eddfc45c66 with Priority: HIGHEST for action security_group_members [ 1490.499877] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f323bfa-211c-48db-8a5d-14eddfc45c66 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.500013] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.500088] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.500320] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.500757] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.500757] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.500757] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.500757] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.500974] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.500974] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f323bfa-211c-48db-8a5d-14eddfc45c66',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1491.003479] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.003711] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.003765] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.003972] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.004082] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.004269] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.004364] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.004426] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.004581] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.004662] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.004750] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f323bfa-211c-48db-8a5d-14eddfc45c66 is going to be updated. [ 1491.031723] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.031904] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.031987] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.032240] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.032372] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.045440] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f323bfa-211c-48db-8a5d-14eddfc45c66 in Status: IN_PROGRESS for 2s [ 1493.056691] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f323bfa-211c-48db-8a5d-14eddfc45c66 in Status: SUCCESS [ 1493.057097] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f323bfa-211c-48db-8a5d-14eddfc45c66 deletion is rescheduled due to dependency. [ 1493.057097] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.625806] env[69506]: INFO networking_nsxv3.common.synchronization [req-14bea462-b65b-4324-9a08-2570daac8f21 req-20f92a46-fe7d-4189-aab3-ffaed2a1315b tempest-ServerActionsTestOtherA-1202948283 tempest-ServerActionsTestOtherA-1202948283-project-member] Enqueued Resource ID: c12eaa8a-f278-4d51-a697-9547755f428e with Priority: HIGHEST for action security_group_members [ 1494.626320] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c12eaa8a-f278-4d51-a697-9547755f428e with Priority: HIGHEST for action security_group_members [ 1494.626648] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-c12eaa8a-f278-4d51-a697-9547755f428e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.626816] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c12eaa8a-f278-4d51-a697-9547755f428e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.626816] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c12eaa8a-f278-4d51-a697-9547755f428e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.627539] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c12eaa8a-f278-4d51-a697-9547755f428e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.627539] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.627539] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.627539] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.627539] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.627926] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.627926] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c12eaa8a-f278-4d51-a697-9547755f428e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1495.079135] env[69506]: INFO networking_nsxv3.common.synchronization [None req-f15c207b-f487-4b26-b5f7-4a311fb06e80 tempest-AttachVolumeShelveTestJSON-1092512781 tempest-AttachVolumeShelveTestJSON-1092512781-project-member] Enqueued Resource ID: deac542f-a57c-4417-81fe-e14b4566b543 with Priority: HIGHEST for action security_group_rules [ 1495.079631] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deac542f-a57c-4417-81fe-e14b4566b543 with Priority: HIGHEST for action security_group_rules [ 1495.079928] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-deac542f-a57c-4417-81fe-e14b4566b543 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.080078] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.080180] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.080471] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.080559] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('deac542f-a57c-4417-81fe-e14b4566b543',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1495.131145] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.131302] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.131375] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.131632] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.131741] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.131937] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.132052] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.132114] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.132463] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.132571] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.132664] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c12eaa8a-f278-4d51-a697-9547755f428e is going to be updated. [ 1495.144449] env[69506]: INFO networking_nsxv3.common.synchronization [None req-4e27672d-eb3f-4a72-95ed-b6daab8dbc9a tempest-AttachVolumeShelveTestJSON-1092512781 tempest-AttachVolumeShelveTestJSON-1092512781-project-member] Enqueued Resource ID: deac542f-a57c-4417-81fe-e14b4566b543 with Priority: HIGHEST for action security_group_rules [ 1495.144690] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deac542f-a57c-4417-81fe-e14b4566b543 with Priority: HIGHEST for action security_group_rules [ 1495.145216] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-deac542f-a57c-4417-81fe-e14b4566b543 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.145317] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.156991] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.157144] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.157187] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.157379] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.157517] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.165691] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c12eaa8a-f278-4d51-a697-9547755f428e in Status: IN_PROGRESS for 2s [ 1495.602275] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.602275] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.602275] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.602275] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.602275] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.602275] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: deac542f-a57c-4417-81fe-e14b4566b543 already deleted. [ 1495.602275] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.602275] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.602275] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.602696] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('deac542f-a57c-4417-81fe-e14b4566b543',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1496.121284] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.121673] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.121673] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.121673] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.121778] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.121813] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: deac542f-a57c-4417-81fe-e14b4566b543 already deleted. [ 1496.121868] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1497.175117] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c12eaa8a-f278-4d51-a697-9547755f428e in Status: SUCCESS [ 1497.175516] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c12eaa8a-f278-4d51-a697-9547755f428e deletion is rescheduled due to dependency. [ 1497.175516] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c12eaa8a-f278-4d51-a697-9547755f428e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.145934] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1500.146285] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1500.766405] env[69506]: INFO networking_nsxv3.common.synchronization [req-dbf17cef-ed78-4079-a6bc-b508acc27cd1 req-66d9f0b8-02cc-46a2-85a2-d576305a0cb8 tempest-AttachVolumeShelveTestJSON-1092512781 tempest-AttachVolumeShelveTestJSON-1092512781-project-member] Enqueued Resource ID: deac542f-a57c-4417-81fe-e14b4566b543 with Priority: HIGHEST for action security_group_members [ 1500.766875] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deac542f-a57c-4417-81fe-e14b4566b543 with Priority: HIGHEST for action security_group_members [ 1500.767226] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-deac542f-a57c-4417-81fe-e14b4566b543 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.767387] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.767425] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.767668] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.767828] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.767964] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.768027] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.768148] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.768234] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.768328] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('deac542f-a57c-4417-81fe-e14b4566b543',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1501.016794] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-38 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.016997] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-38" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.017138] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-38" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.017418] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-38" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.017672] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.017837] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.017958] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.018347] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.018347] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.018568] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1501.018838] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1501.018838] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1501.018938] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1501.019044] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1501.019212] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1501.019298] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1501.038682] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1501.038845] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1501.038984] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1501.039166] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-38" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.039533] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-dded0179-e835-4940-99bc-fd3ec14427f6 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.039724] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-dded0179-e835-4940-99bc-fd3ec14427f6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.039853] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-dded0179-e835-4940-99bc-fd3ec14427f6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.040157] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-dded0179-e835-4940-99bc-fd3ec14427f6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.040295] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dded0179-e835-4940-99bc-fd3ec14427f6',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1501.270873] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.271228] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.271228] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.271301] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.271382] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.271555] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.271653] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.271707] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.271900] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.272022] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.272022] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: deac542f-a57c-4417-81fe-e14b4566b543 already deleted. [ 1501.272136] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.543071] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.543279] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.543427] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.543751] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.543908] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.544088] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port dded0179-e835-4940-99bc-fd3ec14427f6 not found, creating... [ 1501.544402] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.544575] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.544701] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.544931] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.545087] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.545378] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.545544] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.545720] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.545951] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.546106] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.546254] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: dded0179-e835-4940-99bc-fd3ec14427f6 is going to be created. [ 1501.567875] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.568060] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.568172] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.568408] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.568658] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.568884] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-dded0179-e835-4940-99bc-fd3ec14427f6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1502.228132] env[69506]: INFO networking_nsxv3.common.synchronization [req-dbf17cef-ed78-4079-a6bc-b508acc27cd1 req-84fbf87d-e874-41ad-ab20-edec73910388 service nova] Enqueued Resource ID: deac542f-a57c-4417-81fe-e14b4566b543 with Priority: HIGHEST for action security_group_rules [ 1502.228339] env[69506]: INFO networking_nsxv3.common.synchronization [req-dbf17cef-ed78-4079-a6bc-b508acc27cd1 req-84fbf87d-e874-41ad-ab20-edec73910388 service nova] Enqueued Resource ID: deac542f-a57c-4417-81fe-e14b4566b543 with Priority: HIGHEST for action security_group_members [ 1502.228489] env[69506]: INFO networking_nsxv3.common.synchronization [req-dbf17cef-ed78-4079-a6bc-b508acc27cd1 req-84fbf87d-e874-41ad-ab20-edec73910388 service nova] Enqueued Resource ID: dded0179-e835-4940-99bc-fd3ec14427f6 with Priority: HIGHEST for action port [ 1502.228717] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deac542f-a57c-4417-81fe-e14b4566b543 with Priority: HIGHEST for action security_group_rules [ 1502.228852] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deac542f-a57c-4417-81fe-e14b4566b543 with Priority: HIGHEST for action security_group_members [ 1502.228946] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dded0179-e835-4940-99bc-fd3ec14427f6 with Priority: HIGHEST for action port [ 1502.229626] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-deac542f-a57c-4417-81fe-e14b4566b543 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.229775] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1502.229840] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1502.230082] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1502.230165] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('deac542f-a57c-4417-81fe-e14b4566b543',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1502.231012] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-deac542f-a57c-4417-81fe-e14b4566b543 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.231136] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1502.231208] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1502.231373] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1502.231549] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.231646] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1502.231708] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1502.231849] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1502.231932] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1502.232033] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('deac542f-a57c-4417-81fe-e14b4566b543',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1502.232905] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-dded0179-e835-4940-99bc-fd3ec14427f6 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.233050] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dded0179-e835-4940-99bc-fd3ec14427f6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1502.233130] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dded0179-e835-4940-99bc-fd3ec14427f6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1502.234407] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dded0179-e835-4940-99bc-fd3ec14427f6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1502.234407] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dded0179-e835-4940-99bc-fd3ec14427f6',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1502.735273] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-deac542f-a57c-4417-81fe-e14b4566b543 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.735273] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1502.735688] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('deac542f-a57c-4417-81fe-e14b4566b543',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1502.738109] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dded0179-e835-4940-99bc-fd3ec14427f6 with status ACTIVE [ 1502.738297] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.738409] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1502.738512] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1502.738674] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1502.738766] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1502.738935] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.739045] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1502.739193] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1502.739265] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1502.739339] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1502.739518] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.739611] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1502.739670] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1502.739811] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1502.740134] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1502.740134] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dded0179-e835-4940-99bc-fd3ec14427f6 is going to be updated. [ 1502.759439] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.759578] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1502.759627] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1502.759798] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1502.759927] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1502.760091] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dded0179-e835-4940-99bc-fd3ec14427f6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1503.237500] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('deac542f-a57c-4417-81fe-e14b4566b543',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.741054] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.741054] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1503.741422] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1503.741422] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1503.741422] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1503.741527] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: deac542f-a57c-4417-81fe-e14b4566b543 is going to be created. [ 1503.764201] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.764331] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1503.764399] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1503.764597] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1503.764751] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1503.772648] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: deac542f-a57c-4417-81fe-e14b4566b543 in Status: UNINITIALIZED for 2s [ 1503.981276] env[69506]: INFO networking_nsxv3.common.synchronization [req-09d888ba-0cea-47fa-9102-7990e119d96d req-3cfe89f6-e9e2-4005-80a8-d464db5da174 tempest-ServerActionsTestOtherA-1202948283 tempest-ServerActionsTestOtherA-1202948283-project-member] Enqueued Resource ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 with Priority: HIGHEST for action security_group_members [ 1503.981587] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 with Priority: HIGHEST for action security_group_members [ 1503.981894] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.982040] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1503.982106] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1503.982344] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1503.982449] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.982546] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1503.982610] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1503.982751] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1503.982889] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1503.983050] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ec4d2c8-aabb-404a-9e02-8eef8990ffe0',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1504.253803] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-258 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.254027] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-258" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.254166] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-258" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.254466] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-258" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.254728] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.254906] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.255041] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.255265] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.255417] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.255672] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1504.255799] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1504.255917] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1504.256045] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1504.256166] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1504.256278] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1504.256418] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1504.274126] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1504.274290] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1504.274431] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1504.274615] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-258" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.274875] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-c7c8a7ca-b074-4f7f-b1d2-75f20a2df13d taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.275118] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-c7c8a7ca-b074-4f7f-b1d2-75f20a2df13d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.275204] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-c7c8a7ca-b074-4f7f-b1d2-75f20a2df13d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.275472] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-c7c8a7ca-b074-4f7f-b1d2-75f20a2df13d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.275625] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7c8a7ca-b074-4f7f-b1d2-75f20a2df13d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1504.485737] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.485911] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.485975] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.486204] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.486295] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.486490] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.486577] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.486641] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.486817] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.486934] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.486978] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 is going to be updated. [ 1504.511521] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.511672] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.511747] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.511878] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.512028] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.519724] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 in Status: IN_PROGRESS for 2s [ 1504.777893] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.778241] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.778345] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.778587] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.778744] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.778911] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port c7c8a7ca-b074-4f7f-b1d2-75f20a2df13d not found, creating... [ 1504.779195] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.779363] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.779481] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.779707] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.779851] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.780152] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.780313] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.780434] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.780718] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.780787] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.780925] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: c7c8a7ca-b074-4f7f-b1d2-75f20a2df13d is going to be created. [ 1504.824593] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.824893] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.824966] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.825199] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.825426] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.825714] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-c7c8a7ca-b074-4f7f-b1d2-75f20a2df13d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.456565] env[69506]: INFO networking_nsxv3.common.synchronization [req-09d888ba-0cea-47fa-9102-7990e119d96d req-ced28266-efa6-43af-bd20-84216182dede service nova] Enqueued Resource ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 with Priority: HIGHEST for action security_group_rules [ 1505.456754] env[69506]: INFO networking_nsxv3.common.synchronization [req-09d888ba-0cea-47fa-9102-7990e119d96d req-ced28266-efa6-43af-bd20-84216182dede service nova] Enqueued Resource ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 with Priority: HIGHEST for action security_group_members [ 1505.456900] env[69506]: INFO networking_nsxv3.common.synchronization [req-09d888ba-0cea-47fa-9102-7990e119d96d req-ced28266-efa6-43af-bd20-84216182dede service nova] Enqueued Resource ID: c7c8a7ca-b074-4f7f-b1d2-75f20a2df13d with Priority: HIGHEST for action port [ 1505.457148] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 with Priority: HIGHEST for action security_group_rules [ 1505.457277] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 with Priority: HIGHEST for action security_group_members [ 1505.457374] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7c8a7ca-b074-4f7f-b1d2-75f20a2df13d with Priority: HIGHEST for action port [ 1505.457956] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.458121] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.458219] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.458464] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.458499] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ec4d2c8-aabb-404a-9e02-8eef8990ffe0',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.459692] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.459795] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.459987] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-c7c8a7ca-b074-4f7f-b1d2-75f20a2df13d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.460099] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c7c8a7ca-b074-4f7f-b1d2-75f20a2df13d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.460191] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c7c8a7ca-b074-4f7f-b1d2-75f20a2df13d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.460355] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c7c8a7ca-b074-4f7f-b1d2-75f20a2df13d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.460428] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7c8a7ca-b074-4f7f-b1d2-75f20a2df13d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.783555] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: deac542f-a57c-4417-81fe-e14b4566b543 in Status: SUCCESS [ 1505.783917] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.783917] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.784080] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.784270] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.784388] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.784453] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.784606] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.784687] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.784775] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.784874] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('deac542f-a57c-4417-81fe-e14b4566b543',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.962499] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.962686] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.966165] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c7c8a7ca-b074-4f7f-b1d2-75f20a2df13d with status ACTIVE [ 1505.966165] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.966165] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.966165] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.966165] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.966165] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.966165] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.966165] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.966165] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.966165] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.966518] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.966518] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.966518] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.966631] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.966930] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.966930] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.966930] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c7c8a7ca-b074-4f7f-b1d2-75f20a2df13d is going to be updated. [ 1505.987071] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.987237] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.987317] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.987490] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.987636] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.987797] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c7c8a7ca-b074-4f7f-b1d2-75f20a2df13d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.286865] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('deac542f-a57c-4417-81fe-e14b4566b543',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1506.530068] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 in Status: SUCCESS [ 1506.530258] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 deletion is rescheduled due to dependency. [ 1506.530369] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.530534] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.530748] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.530954] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.531077] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.531142] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.531292] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.531374] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.531469] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ec4d2c8-aabb-404a-9e02-8eef8990ffe0',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1506.788732] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for deac542f-a57c-4417-81fe-e14b4566b543: rpc.has_security_group_logging(os_id): False [ 1506.805878] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.806019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.806086] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.806285] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.806373] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.806600] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.806732] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.806799] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.806951] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.807039] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.807126] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: deac542f-a57c-4417-81fe-e14b4566b543 is going to be created. [ 1506.860020] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.860179] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.860228] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.860376] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.860540] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.869802] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: deac542f-a57c-4417-81fe-e14b4566b543 in Status: IN_PROGRESS for 2s [ 1507.034182] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5ec4d2c8-aabb-404a-9e02-8eef8990ffe0',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1507.536495] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5ec4d2c8-aabb-404a-9e02-8eef8990ffe0',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.039073] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.039470] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.039470] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.039556] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.039595] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.039690] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 is going to be updated. [ 1508.064820] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.064998] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.065059] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.065193] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.065330] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.072357] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 in Status: IN_PROGRESS for 2s [ 1508.879829] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: deac542f-a57c-4417-81fe-e14b4566b543 in Status: SUCCESS [ 1508.880061] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.081689] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 in Status: SUCCESS [ 1510.082105] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.082105] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.082242] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.082447] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.082603] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.082708] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.082918] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.083057] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.083197] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.083316] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5ec4d2c8-aabb-404a-9e02-8eef8990ffe0',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1510.457947] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1510.458146] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1510.585883] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.586081] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.586142] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.586333] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.586502] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.586604] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.586682] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.586839] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.586925] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.587035] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.587186] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.587279] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.587342] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.587480] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.587619] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.587710] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.587772] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.587906] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.587991] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.588097] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.588185] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5ec4d2c8-aabb-404a-9e02-8eef8990ffe0',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.090416] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0: rpc.has_security_group_logging(os_id): False [ 1511.109877] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.110124] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.110187] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.110361] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.110452] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.110709] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.110811] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.110876] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.111076] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.111193] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.111304] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.111393] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.111456] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.111664] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.111769] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.111992] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.112118] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.112182] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.112348] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.112441] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.112556] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 is going to be updated. [ 1511.170238] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.170483] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.170483] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.170645] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.170834] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.193359] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 in Status: IN_PROGRESS for 2s [ 1512.848023] env[69506]: INFO networking_nsxv3.common.synchronization [req-8a9f1ea6-dcf2-49b1-ae0f-c9bffc935baf req-bb5d99f9-8115-423e-b589-11718b951db2 tempest-ServerActionsTestOtherA-1202948283 tempest-ServerActionsTestOtherA-1202948283-project-member] Enqueued Resource ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 with Priority: HIGHEST for action security_group_members [ 1512.848872] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 with Priority: HIGHEST for action security_group_members [ 1512.849191] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.849319] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.849390] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.849589] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.849743] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.849844] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.850689] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.850689] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.850689] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.850689] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ec4d2c8-aabb-404a-9e02-8eef8990ffe0',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1512.886851] env[69506]: INFO networking_nsxv3.common.synchronization [req-8a9f1ea6-dcf2-49b1-ae0f-c9bffc935baf req-bb5d99f9-8115-423e-b589-11718b951db2 tempest-ServerActionsTestOtherA-1202948283 tempest-ServerActionsTestOtherA-1202948283-project-member] Enqueued Resource ID: c7c8a7ca-b074-4f7f-b1d2-75f20a2df13d with Priority: HIGHEST for action port [ 1512.886851] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7c8a7ca-b074-4f7f-b1d2-75f20a2df13d with Priority: HIGHEST for action port [ 1512.886851] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-c7c8a7ca-b074-4f7f-b1d2-75f20a2df13d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.886851] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c7c8a7ca-b074-4f7f-b1d2-75f20a2df13d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.886851] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c7c8a7ca-b074-4f7f-b1d2-75f20a2df13d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.886851] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c7c8a7ca-b074-4f7f-b1d2-75f20a2df13d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.886851] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7c8a7ca-b074-4f7f-b1d2-75f20a2df13d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1513.207009] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 in Status: SUCCESS [ 1513.207257] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.352180] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.352334] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.352413] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.352631] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.352763] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.352977] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.353104] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.353165] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.353327] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.353405] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.353495] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 is going to be updated. [ 1513.379696] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.379869] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.379932] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.380088] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.380256] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.388584] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 in Status: IN_PROGRESS for 2s [ 1513.388771] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c7c8a7ca-b074-4f7f-b1d2-75f20a2df13d with status ACTIVE [ 1513.388959] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.389105] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.389184] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.389316] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.389387] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.389566] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.389684] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.389782] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.389944] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.390039] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.390232] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.390327] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.390384] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.390523] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.390596] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.390678] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c7c8a7ca-b074-4f7f-b1d2-75f20a2df13d is going to be updated. [ 1513.407874] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.408023] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.408068] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.408242] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.408368] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.408512] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c7c8a7ca-b074-4f7f-b1d2-75f20a2df13d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1515.402185] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 in Status: SUCCESS [ 1515.402604] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 deletion is rescheduled due to dependency. [ 1515.402604] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.886845] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1517.887256] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1522.888168] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1522.888565] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1527.889888] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1527.889888] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1532.890863] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1532.891234] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1536.664521] env[69506]: INFO networking_nsxv3.common.synchronization [req-82bed60b-82df-4639-aaff-8fb5851754be req-853ad7ab-592f-4772-8937-c95200302bba tempest-ServerActionsTestOtherA-1202948283 tempest-ServerActionsTestOtherA-1202948283-project-member] Enqueued Resource ID: f6403698-8563-49d1-9b04-d2bd0547964d with Priority: HIGHEST for action security_group_members [ 1536.665075] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6403698-8563-49d1-9b04-d2bd0547964d with Priority: HIGHEST for action security_group_members [ 1536.665413] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6403698-8563-49d1-9b04-d2bd0547964d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.665547] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.665613] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.665828] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.665994] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.666234] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.666302] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.666462] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.666550] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.666638] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6403698-8563-49d1-9b04-d2bd0547964d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1537.153029] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-258 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.153253] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-258" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.153386] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-258" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.153660] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-258" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.153928] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.154104] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.154229] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.154452] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.154603] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.154822] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1537.154942] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1537.155201] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1537.155344] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1537.155469] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1537.155582] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1537.155723] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1537.168246] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f6403698-8563-49d1-9b04-d2bd0547964d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1537.174426] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1537.174724] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1537.174724] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1537.174912] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-258" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.175169] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-4544112d-c9b6-4f41-a052-1513454b6d3a taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.175338] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-4544112d-c9b6-4f41-a052-1513454b6d3a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.175463] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-4544112d-c9b6-4f41-a052-1513454b6d3a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.175833] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-4544112d-c9b6-4f41-a052-1513454b6d3a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.176013] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4544112d-c9b6-4f41-a052-1513454b6d3a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1537.671219] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f6403698-8563-49d1-9b04-d2bd0547964d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1537.678689] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.678912] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.679090] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.679375] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.679531] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.679736] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Segment Port 4544112d-c9b6-4f41-a052-1513454b6d3a not found, creating... [ 1537.679957] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.680168] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.680348] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.680611] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.680763] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.681066] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.681239] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.681358] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.681574] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.681731] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.681945] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: 4544112d-c9b6-4f41-a052-1513454b6d3a is going to be created. [ 1537.701530] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.701719] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.701833] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.702075] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.702297] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.702514] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-4544112d-c9b6-4f41-a052-1513454b6d3a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1538.173859] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1538.173859] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1538.173859] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1538.174155] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1538.174208] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1538.174290] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6403698-8563-49d1-9b04-d2bd0547964d is going to be updated. [ 1538.202788] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1538.202942] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1538.202985] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1538.203180] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1538.203319] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1538.212238] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6403698-8563-49d1-9b04-d2bd0547964d in Status: IN_PROGRESS for 2s [ 1538.354557] env[69506]: INFO networking_nsxv3.common.synchronization [req-82bed60b-82df-4639-aaff-8fb5851754be req-274631a6-dfca-4d60-810c-5379bfae3c32 service nova] Enqueued Resource ID: f6403698-8563-49d1-9b04-d2bd0547964d with Priority: HIGHEST for action security_group_rules [ 1538.354744] env[69506]: INFO networking_nsxv3.common.synchronization [req-82bed60b-82df-4639-aaff-8fb5851754be req-274631a6-dfca-4d60-810c-5379bfae3c32 service nova] Enqueued Resource ID: f6403698-8563-49d1-9b04-d2bd0547964d with Priority: HIGHEST for action security_group_members [ 1538.355019] env[69506]: INFO networking_nsxv3.common.synchronization [req-82bed60b-82df-4639-aaff-8fb5851754be req-274631a6-dfca-4d60-810c-5379bfae3c32 service nova] Enqueued Resource ID: 4544112d-c9b6-4f41-a052-1513454b6d3a with Priority: HIGHEST for action port [ 1538.355119] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6403698-8563-49d1-9b04-d2bd0547964d with Priority: HIGHEST for action security_group_rules [ 1538.355247] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6403698-8563-49d1-9b04-d2bd0547964d with Priority: HIGHEST for action security_group_members [ 1538.355343] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4544112d-c9b6-4f41-a052-1513454b6d3a with Priority: HIGHEST for action port [ 1538.355872] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6403698-8563-49d1-9b04-d2bd0547964d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1538.356030] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1538.356105] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1538.356298] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1538.356377] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6403698-8563-49d1-9b04-d2bd0547964d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1538.357196] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6403698-8563-49d1-9b04-d2bd0547964d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1538.357286] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1538.357465] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-4544112d-c9b6-4f41-a052-1513454b6d3a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1538.357571] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4544112d-c9b6-4f41-a052-1513454b6d3a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1538.357631] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4544112d-c9b6-4f41-a052-1513454b6d3a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1538.357775] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4544112d-c9b6-4f41-a052-1513454b6d3a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1538.357859] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4544112d-c9b6-4f41-a052-1513454b6d3a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1538.859703] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6403698-8563-49d1-9b04-d2bd0547964d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1538.859969] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1538.860054] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4544112d-c9b6-4f41-a052-1513454b6d3a with status ACTIVE [ 1538.860268] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1538.860387] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1538.860454] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1538.860844] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1538.860844] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1538.860921] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1538.860976] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1538.861084] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1538.861196] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1538.861274] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1538.861457] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1538.861549] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1538.861608] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1538.861747] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1538.861820] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1538.861903] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4544112d-c9b6-4f41-a052-1513454b6d3a is going to be updated. [ 1538.880808] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1538.880946] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1538.880992] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1538.881184] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1538.881312] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1538.881468] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4544112d-c9b6-4f41-a052-1513454b6d3a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.220976] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6403698-8563-49d1-9b04-d2bd0547964d in Status: SUCCESS [ 1540.221378] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.221378] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.221574] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.221760] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.221873] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.221939] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.222106] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.222188] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.222282] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6403698-8563-49d1-9b04-d2bd0547964d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1540.724590] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f6403698-8563-49d1-9b04-d2bd0547964d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1541.226993] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f6403698-8563-49d1-9b04-d2bd0547964d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1541.729199] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.729447] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.729447] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.729633] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.729724] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.729827] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6403698-8563-49d1-9b04-d2bd0547964d is going to be updated. [ 1541.756289] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.756490] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.756490] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.756675] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.756857] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.764590] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6403698-8563-49d1-9b04-d2bd0547964d in Status: IN_PROGRESS for 2s [ 1543.356520] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1543.356960] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1543.775047] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6403698-8563-49d1-9b04-d2bd0547964d in Status: SUCCESS [ 1543.775277] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1543.775552] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1543.775659] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1543.775846] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1543.775999] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1543.776074] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1543.776230] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1543.776311] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1543.776399] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1543.776495] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f6403698-8563-49d1-9b04-d2bd0547964d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1544.278429] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f6403698-8563-49d1-9b04-d2bd0547964d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1544.781363] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f6403698-8563-49d1-9b04-d2bd0547964d: rpc.has_security_group_logging(os_id): False [ 1544.798454] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1544.798604] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1544.798604] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1544.798771] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1544.815572] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1544.815851] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1544.815982] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1544.816073] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1544.816259] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1544.816342] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1544.816435] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6403698-8563-49d1-9b04-d2bd0547964d is going to be updated. [ 1544.871716] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1544.871900] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1544.871900] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1544.872103] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1544.872246] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1544.883871] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6403698-8563-49d1-9b04-d2bd0547964d in Status: IN_PROGRESS for 2s [ 1545.127498] env[69506]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1545.127693] env[69506]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-6bca40e9-8ac8-4d68-9af5-be75480fde8d None None] NSXv3 Agent Agent loop - iteration:4 started [ 1546.896657] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6403698-8563-49d1-9b04-d2bd0547964d in Status: SUCCESS [ 1546.896657] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.357209] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1548.357518] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1553.359012] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1553.359290] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1558.360144] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1558.360548] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1563.361600] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1563.362030] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1568.362401] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1568.362776] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1572.708046] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock network-38 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.708046] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "network-38" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.708046] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "network-38" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.708496] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "network-38" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.708496] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.708645] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.708741] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.708944] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.709105] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1572.709330] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1572.709451] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] NeedRegenerationException {{(pid=69506) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1572.709566] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] no value, waiting for create lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1572.709678] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] value creation lock acquired {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1572.709790] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] No value present for key: 'zone-id' {{(pid=69506) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1572.709898] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Calling creation function for not-yet-present value {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1572.710041] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1572.728850] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1572.728999] env[69506]: DEBUG dogpile.cache.region [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69506) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1572.729160] env[69506]: DEBUG dogpile.lock [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Released creation lock {{(pid=69506) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1572.729328] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "network-38" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1572.729609] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock port-dded0179-e835-4940-99bc-fd3ec14427f6 taken with stack trace [, , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.729777] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "port-dded0179-e835-4940-99bc-fd3ec14427f6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.729929] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "port-dded0179-e835-4940-99bc-fd3ec14427f6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.730177] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "port-dded0179-e835-4940-99bc-fd3ec14427f6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.730322] env[69506]: DEBUG networking_nsxv3.api.rpc [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dded0179-e835-4940-99bc-fd3ec14427f6',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1573.232235] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.232445] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.232504] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.232780] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.232939] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.233258] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.233425] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.233551] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.233774] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.233918] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.234215] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.234375] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.234497] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.234709] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.234861] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.235015] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Resource: SegmentPort with ID: dded0179-e835-4940-99bc-fd3ec14427f6 is going to be updated. [ 1573.254584] env[69506]: DEBUG networking_nsxv3.common.locking [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.254746] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.254877] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.255116] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.255301] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.255513] env[69506]: DEBUG oslo_concurrency.lockutils [None req-8ab2cff6-5fae-49e2-ae34-81487bffcb7f None None] Releasing lock "port-dded0179-e835-4940-99bc-fd3ec14427f6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.363466] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1573.363661] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1573.905147] env[69506]: INFO networking_nsxv3.common.synchronization [req-5a0b2b6a-1b92-4867-99cc-b63368d57f69 req-cc81831c-df2c-46ed-886f-c5b27555d723 service nova] Enqueued Resource ID: deac542f-a57c-4417-81fe-e14b4566b543 with Priority: HIGHEST for action security_group_rules [ 1573.905421] env[69506]: INFO networking_nsxv3.common.synchronization [req-5a0b2b6a-1b92-4867-99cc-b63368d57f69 req-cc81831c-df2c-46ed-886f-c5b27555d723 service nova] Enqueued Resource ID: deac542f-a57c-4417-81fe-e14b4566b543 with Priority: HIGHEST for action security_group_members [ 1573.905507] env[69506]: INFO networking_nsxv3.common.synchronization [req-5a0b2b6a-1b92-4867-99cc-b63368d57f69 req-cc81831c-df2c-46ed-886f-c5b27555d723 service nova] Enqueued Resource ID: dded0179-e835-4940-99bc-fd3ec14427f6 with Priority: HIGHEST for action port [ 1573.905709] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deac542f-a57c-4417-81fe-e14b4566b543 with Priority: HIGHEST for action security_group_rules [ 1573.905901] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deac542f-a57c-4417-81fe-e14b4566b543 with Priority: HIGHEST for action security_group_members [ 1573.905946] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dded0179-e835-4940-99bc-fd3ec14427f6 with Priority: HIGHEST for action port [ 1573.906483] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-deac542f-a57c-4417-81fe-e14b4566b543 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.906610] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.906694] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.906866] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.906947] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('deac542f-a57c-4417-81fe-e14b4566b543',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1573.907739] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-deac542f-a57c-4417-81fe-e14b4566b543 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.907849] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.907910] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.908080] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.908224] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.908316] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.908375] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.908518] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.908638] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.908763] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('deac542f-a57c-4417-81fe-e14b4566b543',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1573.909435] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock port-dded0179-e835-4940-99bc-fd3ec14427f6 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.909534] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dded0179-e835-4940-99bc-fd3ec14427f6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.909601] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dded0179-e835-4940-99bc-fd3ec14427f6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.909823] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dded0179-e835-4940-99bc-fd3ec14427f6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.909823] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dded0179-e835-4940-99bc-fd3ec14427f6',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1574.412050] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('deac542f-a57c-4417-81fe-e14b4566b543',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1574.413099] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-deac542f-a57c-4417-81fe-e14b4566b543 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.413277] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.414029] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dded0179-e835-4940-99bc-fd3ec14427f6 with status ACTIVE [ 1574.414029] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.414029] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.414029] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.414337] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.414337] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.414584] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.414736] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.414839] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.415098] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.415233] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.415508] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.415658] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.415761] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.415973] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.416114] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.416289] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dded0179-e835-4940-99bc-fd3ec14427f6 is going to be updated. [ 1574.436776] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.436942] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.437019] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.437229] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.437381] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.437554] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dded0179-e835-4940-99bc-fd3ec14427f6" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.918915] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('deac542f-a57c-4417-81fe-e14b4566b543',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1575.421705] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1575.421939] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1575.421939] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1575.422161] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1575.422257] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1575.422361] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: deac542f-a57c-4417-81fe-e14b4566b543 is going to be updated. [ 1575.449673] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1575.449936] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1575.449936] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1575.450072] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1575.450221] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1575.459417] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: deac542f-a57c-4417-81fe-e14b4566b543 in Status: IN_PROGRESS for 2s [ 1577.469783] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: deac542f-a57c-4417-81fe-e14b4566b543 in Status: SUCCESS [ 1577.470192] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1577.470192] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1577.470367] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1577.470561] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1577.470678] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1577.470744] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1577.470902] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1577.470984] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1577.471084] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1577.471176] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('deac542f-a57c-4417-81fe-e14b4566b543',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1577.973306] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('deac542f-a57c-4417-81fe-e14b4566b543',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1578.476374] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for deac542f-a57c-4417-81fe-e14b4566b543: rpc.has_security_group_logging(os_id): False [ 1578.494864] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.495159] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.495259] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.495552] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.495710] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.496129] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.496359] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.496463] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.496712] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.496848] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.496991] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: deac542f-a57c-4417-81fe-e14b4566b543 is going to be updated. [ 1578.552364] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.552609] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.552676] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.552971] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.553207] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.566309] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: deac542f-a57c-4417-81fe-e14b4566b543 in Status: IN_PROGRESS for 2s [ 1578.907397] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1578.907607] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1580.581906] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: deac542f-a57c-4417-81fe-e14b4566b543 in Status: SUCCESS [ 1580.582340] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1581.063073] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1581.063352] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1581.063352] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1581.063513] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1581.063611] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1581.565983] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1582.068794] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1582.571480] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1582.571745] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1583.383767] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.384347] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.384347] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.384461] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.583967] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1583.585490] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.587325] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1583.623314] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.623562] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.623562] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.623774] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.638891] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.640045] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1583.640239] env[69506]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69506) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1583.640336] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1583.669322] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.669635] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.669635] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.669798] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.670477] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.670719] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1583.744058] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.744328] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.744328] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.744624] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.744849] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.745162] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1583.815058] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.815250] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.815290] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.815501] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.815798] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.816645] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:22. [ 1583.816645] env[69506]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'5ec4d2c8-aabb-404a-9e02-8eef8990ffe0', '74f7fdee-99f0-4620-9ae9-86ee28797058', '28204c48-8cc9-4a78-9ae1-cbf9a28e9016', '7d0db323-2ed4-4f6a-a30a-405b16133cb2', '7e307bb5-2c7b-4260-88ec-90f13f2de5d2', 'c141011f-1c58-45cb-b73c-ad882255b77a', 'f6403698-8563-49d1-9b04-d2bd0547964d', '7f323bfa-211c-48db-8a5d-14eddfc45c66', '823c6679-501c-4ec2-9d9f-f49b7cc1205d', '9f130eeb-c453-4570-b0fe-743f47890102', 'c12eaa8a-f278-4d51-a697-9547755f428e', '40ac1d9f-7f09-4603-ba34-b3f5910e1da2', '008501d4-938b-4336-9c1d-ef3665f7d09d', 'cb920054-1c0f-4a74-aad1-8ca7ce036993', 'e583692f-de45-4011-b07f-87e665a77040', '65fb79f7-95e7-4be9-b5bb-64c57bc42333', '56c2fe94-2993-4f31-a331-b0611a88cec2', '9ce980c1-0c92-48ab-930f-2537a5f82269', 'deac542f-a57c-4417-81fe-e14b4566b543', '9e830a1e-918a-49a7-b725-f68307282e6e', '39f6b94d-d05c-4309-8b06-e27ba3215b09', '0745f36a-3469-4c49-9c0f-8111fe1bd802'} {{(pid=69506) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1583.816645] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1583.834308] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.834513] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.834513] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.834681] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.834769] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.834881] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1583.834951] env[69506]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69506) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1583.835054] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1583.911557] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.911875] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.912046] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.912415] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.914603] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.915174] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1583.915301] env[69506]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69506) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1583.915443] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1583.915592] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1583.915729] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/22 resources of Type:Security Group Rules [ 1583.915846] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 with Priority: HIGH for action security_group_rules [ 1583.915989] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 with Priority: HIGH for action security_group_rules [ 1583.916138] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 28204c48-8cc9-4a78-9ae1-cbf9a28e9016 with Priority: HIGH for action security_group_rules [ 1583.916261] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGH for action security_group_rules [ 1583.916363] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7e307bb5-2c7b-4260-88ec-90f13f2de5d2 with Priority: HIGH for action security_group_rules [ 1583.916473] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c141011f-1c58-45cb-b73c-ad882255b77a with Priority: HIGH for action security_group_rules [ 1583.916590] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f6403698-8563-49d1-9b04-d2bd0547964d with Priority: HIGH for action security_group_rules [ 1583.916704] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7f323bfa-211c-48db-8a5d-14eddfc45c66 with Priority: HIGH for action security_group_rules [ 1583.916818] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d with Priority: HIGH for action security_group_rules [ 1583.916936] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9f130eeb-c453-4570-b0fe-743f47890102 with Priority: HIGH for action security_group_rules [ 1583.917070] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c12eaa8a-f278-4d51-a697-9547755f428e with Priority: HIGH for action security_group_rules [ 1583.917187] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 40ac1d9f-7f09-4603-ba34-b3f5910e1da2 with Priority: HIGH for action security_group_rules [ 1583.917313] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGH for action security_group_rules [ 1583.917434] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cb920054-1c0f-4a74-aad1-8ca7ce036993 with Priority: HIGH for action security_group_rules [ 1583.917675] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e583692f-de45-4011-b07f-87e665a77040 with Priority: HIGH for action security_group_rules [ 1583.917675] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 with Priority: HIGH for action security_group_rules [ 1583.917834] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 with Priority: HIGH for action security_group_rules [ 1583.917883] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9ce980c1-0c92-48ab-930f-2537a5f82269 with Priority: HIGH for action security_group_rules [ 1583.917944] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: deac542f-a57c-4417-81fe-e14b4566b543 with Priority: HIGH for action security_group_rules [ 1583.918075] env[69506]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9e830a1e-918a-49a7-b725-f68307282e6e with Priority: HIGH for action security_group_rules [ 1583.918319] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.918688] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1583.918824] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1583.919058] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 with Priority: HIGH for action security_group_rules [ 1583.919301] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28204c48-8cc9-4a78-9ae1-cbf9a28e9016 with Priority: HIGH for action security_group_rules [ 1583.919485] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6403698-8563-49d1-9b04-d2bd0547964d with Priority: HIGH for action security_group_rules [ 1583.919673] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e583692f-de45-4011-b07f-87e665a77040 with Priority: HIGH for action security_group_rules [ 1583.919859] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e830a1e-918a-49a7-b725-f68307282e6e with Priority: HIGH for action security_group_rules [ 1583.920058] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deac542f-a57c-4417-81fe-e14b4566b543 with Priority: HIGH for action security_group_rules [ 1583.920248] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ce980c1-0c92-48ab-930f-2537a5f82269 with Priority: HIGH for action security_group_rules [ 1583.920438] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 with Priority: HIGH for action security_group_rules [ 1583.920627] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb920054-1c0f-4a74-aad1-8ca7ce036993 with Priority: HIGH for action security_group_rules [ 1583.920791] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 with Priority: HIGH for action security_group_rules [ 1583.920950] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 008501d4-938b-4336-9c1d-ef3665f7d09d with Priority: HIGH for action security_group_rules [ 1583.921147] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40ac1d9f-7f09-4603-ba34-b3f5910e1da2 with Priority: HIGH for action security_group_rules [ 1583.921323] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c12eaa8a-f278-4d51-a697-9547755f428e with Priority: HIGH for action security_group_rules [ 1583.921504] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f130eeb-c453-4570-b0fe-743f47890102 with Priority: HIGH for action security_group_rules [ 1583.921683] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d with Priority: HIGH for action security_group_rules [ 1583.921867] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c141011f-1c58-45cb-b73c-ad882255b77a with Priority: HIGH for action security_group_rules [ 1583.922065] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f323bfa-211c-48db-8a5d-14eddfc45c66 with Priority: HIGH for action security_group_rules [ 1583.922246] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e307bb5-2c7b-4260-88ec-90f13f2de5d2 with Priority: HIGH for action security_group_rules [ 1583.922393] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 with Priority: HIGH for action security_group_rules [ 1583.922578] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 with Priority: HIGH for action security_group_rules [ 1583.923155] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.923383] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.923516] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.923843] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.923995] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ec4d2c8-aabb-404a-9e02-8eef8990ffe0',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1583.925559] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28204c48-8cc9-4a78-9ae1-cbf9a28e9016 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.925764] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.925893] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.926227] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.926392] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28204c48-8cc9-4a78-9ae1-cbf9a28e9016',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1583.928342] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6403698-8563-49d1-9b04-d2bd0547964d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.928569] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.928677] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.928975] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.929139] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6403698-8563-49d1-9b04-d2bd0547964d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1583.930413] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e583692f-de45-4011-b07f-87e665a77040 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.930621] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e583692f-de45-4011-b07f-87e665a77040" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.930774] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e583692f-de45-4011-b07f-87e665a77040" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.931060] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e583692f-de45-4011-b07f-87e665a77040" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.931359] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e583692f-de45-4011-b07f-87e665a77040',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1583.932415] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e830a1e-918a-49a7-b725-f68307282e6e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.932596] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e830a1e-918a-49a7-b725-f68307282e6e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.932703] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e830a1e-918a-49a7-b725-f68307282e6e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.932969] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e830a1e-918a-49a7-b725-f68307282e6e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.933122] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e830a1e-918a-49a7-b725-f68307282e6e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1583.934358] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-deac542f-a57c-4417-81fe-e14b4566b543 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.934477] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.934607] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.934890] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.935046] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('deac542f-a57c-4417-81fe-e14b4566b543',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1583.936381] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ce980c1-0c92-48ab-930f-2537a5f82269 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.936566] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ce980c1-0c92-48ab-930f-2537a5f82269" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.936666] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ce980c1-0c92-48ab-930f-2537a5f82269" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.936934] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ce980c1-0c92-48ab-930f-2537a5f82269" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.937084] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ce980c1-0c92-48ab-930f-2537a5f82269',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1583.938222] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-56c2fe94-2993-4f31-a331-b0611a88cec2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.938446] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.938538] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.938810] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.938948] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('56c2fe94-2993-4f31-a331-b0611a88cec2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1583.940101] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb920054-1c0f-4a74-aad1-8ca7ce036993 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.940298] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb920054-1c0f-4a74-aad1-8ca7ce036993" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.940426] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb920054-1c0f-4a74-aad1-8ca7ce036993" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.940703] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb920054-1c0f-4a74-aad1-8ca7ce036993" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.940841] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb920054-1c0f-4a74-aad1-8ca7ce036993',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1583.942173] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65fb79f7-95e7-4be9-b5bb-64c57bc42333 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.942330] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.942438] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.942680] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.942818] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65fb79f7-95e7-4be9-b5bb-64c57bc42333',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1583.943953] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-008501d4-938b-4336-9c1d-ef3665f7d09d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.944136] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.944265] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.944527] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.944666] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('008501d4-938b-4336-9c1d-ef3665f7d09d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1583.945799] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40ac1d9f-7f09-4603-ba34-b3f5910e1da2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.945935] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40ac1d9f-7f09-4603-ba34-b3f5910e1da2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.946074] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40ac1d9f-7f09-4603-ba34-b3f5910e1da2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.946361] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40ac1d9f-7f09-4603-ba34-b3f5910e1da2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.946649] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40ac1d9f-7f09-4603-ba34-b3f5910e1da2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1583.947719] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c12eaa8a-f278-4d51-a697-9547755f428e taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.947968] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c12eaa8a-f278-4d51-a697-9547755f428e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.948048] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c12eaa8a-f278-4d51-a697-9547755f428e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.948316] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c12eaa8a-f278-4d51-a697-9547755f428e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.948516] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c12eaa8a-f278-4d51-a697-9547755f428e',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1583.949544] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f130eeb-c453-4570-b0fe-743f47890102 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.949740] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f130eeb-c453-4570-b0fe-743f47890102" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.949854] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f130eeb-c453-4570-b0fe-743f47890102" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.950140] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f130eeb-c453-4570-b0fe-743f47890102" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.950268] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f130eeb-c453-4570-b0fe-743f47890102',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1583.951369] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-823c6679-501c-4ec2-9d9f-f49b7cc1205d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.951557] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.951681] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.951940] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.952092] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('823c6679-501c-4ec2-9d9f-f49b7cc1205d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1583.953324] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c141011f-1c58-45cb-b73c-ad882255b77a taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.953520] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c141011f-1c58-45cb-b73c-ad882255b77a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.953648] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c141011f-1c58-45cb-b73c-ad882255b77a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.953920] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c141011f-1c58-45cb-b73c-ad882255b77a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.954081] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c141011f-1c58-45cb-b73c-ad882255b77a',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1583.955172] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f323bfa-211c-48db-8a5d-14eddfc45c66 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.955371] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.955501] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.955804] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.955870] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f323bfa-211c-48db-8a5d-14eddfc45c66',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1583.956999] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e307bb5-2c7b-4260-88ec-90f13f2de5d2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.957199] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e307bb5-2c7b-4260-88ec-90f13f2de5d2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.957319] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e307bb5-2c7b-4260-88ec-90f13f2de5d2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.957560] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e307bb5-2c7b-4260-88ec-90f13f2de5d2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.957695] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e307bb5-2c7b-4260-88ec-90f13f2de5d2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1583.958789] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-74f7fdee-99f0-4620-9ae9-86ee28797058 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.958983] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.959122] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.959391] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.959531] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('74f7fdee-99f0-4620-9ae9-86ee28797058',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1583.960771] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d0db323-2ed4-4f6a-a30a-405b16133cb2 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.960961] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.961110] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.961373] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.961521] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d0db323-2ed4-4f6a-a30a-405b16133cb2',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1583.979363] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6403698-8563-49d1-9b04-d2bd0547964d taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.979606] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.979754] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.980126] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.980411] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.980593] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.980730] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.980985] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.981164] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.981348] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.981522] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f6403698-8563-49d1-9b04-d2bd0547964d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1584.017295] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.017549] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.017549] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.017694] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.019496] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.019606] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.020670] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.020768] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.021484] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.021583] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.022337] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.022445] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.023161] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.023255] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.023948] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.024056] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.024751] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.024846] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.033434] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.033608] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28204c48-8cc9-4a78-9ae1-cbf9a28e9016 is going to be deleted. [ 1584.034425] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.034628] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.054665] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.054845] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f323bfa-211c-48db-8a5d-14eddfc45c66 is going to be deleted. [ 1584.055744] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.055980] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.074743] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.074921] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb920054-1c0f-4a74-aad1-8ca7ce036993 is going to be deleted. [ 1584.075771] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.076000] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.085724] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.086302] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.097140] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.097307] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d0db323-2ed4-4f6a-a30a-405b16133cb2 is going to be deleted. [ 1584.098170] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.098392] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.118987] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.119169] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ec4d2c8-aabb-404a-9e02-8eef8990ffe0 is going to be deleted. [ 1584.120167] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.120407] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.121846] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.121962] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.134987] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.135133] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.153116] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.153260] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.159613] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.159731] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c141011f-1c58-45cb-b73c-ad882255b77a is going to be deleted. [ 1584.160586] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.160790] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.199958] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.200080] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e830a1e-918a-49a7-b725-f68307282e6e is going to be deleted. [ 1584.200792] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.200981] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.214520] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.214633] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.251518] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.251626] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e583692f-de45-4011-b07f-87e665a77040 is going to be deleted. [ 1584.253045] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.253045] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.253045] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.253045] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28204c48-8cc9-4a78-9ae1-cbf9a28e9016" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.253045] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.253045] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.253327] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.253327] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f323bfa-211c-48db-8a5d-14eddfc45c66" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.253587] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.253762] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.253841] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.253971] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb920054-1c0f-4a74-aad1-8ca7ce036993" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.254108] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.254252] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.254346] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.254491] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d0db323-2ed4-4f6a-a30a-405b16133cb2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.254594] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.254730] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.254801] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.254901] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ec4d2c8-aabb-404a-9e02-8eef8990ffe0" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.280579] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.280714] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.280774] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.280927] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.281013] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.281132] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c141011f-1c58-45cb-b73c-ad882255b77a" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.326036] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.326211] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.326309] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.326537] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.326698] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.326820] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e830a1e-918a-49a7-b725-f68307282e6e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.410922] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.411268] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.411268] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.411367] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.411496] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.411555] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e583692f-de45-4011-b07f-87e665a77040" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.469202] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-deac542f-a57c-4417-81fe-e14b4566b543 taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.469444] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.469444] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.469576] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.469734] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.469822] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.469887] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.470032] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.470120] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.470203] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.470286] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('deac542f-a57c-4417-81fe-e14b4566b543',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1584.491415] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f6403698-8563-49d1-9b04-d2bd0547964d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1584.515024] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.515221] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.515405] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.515505] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.517297] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.517434] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.518013] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.518125] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.518721] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.518818] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.519428] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.519514] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.520137] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.520228] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.520837] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.520931] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.521555] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.521649] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.522364] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.522454] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.523351] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.523442] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.548438] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.548551] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e307bb5-2c7b-4260-88ec-90f13f2de5d2 is going to be deleted. [ 1584.549309] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.549491] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.567466] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.567603] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ce980c1-0c92-48ab-930f-2537a5f82269 is going to be deleted. [ 1584.568505] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.568596] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.587155] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.587263] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 56c2fe94-2993-4f31-a331-b0611a88cec2 is going to be deleted. [ 1584.587937] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.588135] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.600812] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.600965] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.605658] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.605772] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65fb79f7-95e7-4be9-b5bb-64c57bc42333 is going to be deleted. [ 1584.606483] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.606655] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.622787] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.622905] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.629186] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.629306] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 008501d4-938b-4336-9c1d-ef3665f7d09d is going to be deleted. [ 1584.629995] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.630189] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.648734] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.648864] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 74f7fdee-99f0-4620-9ae9-86ee28797058 is going to be deleted. [ 1584.649587] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.649751] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.650933] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.651037] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.667472] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.667581] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.690508] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.690634] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.691140] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.691242] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40ac1d9f-7f09-4603-ba34-b3f5910e1da2 is going to be deleted. [ 1584.691957] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.692146] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.730710] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.730819] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c12eaa8a-f278-4d51-a697-9547755f428e is going to be deleted. [ 1584.731556] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.731738] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.751682] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.751799] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f130eeb-c453-4570-b0fe-743f47890102 is going to be deleted. [ 1584.752590] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.752768] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.777603] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.777787] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.788147] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.788274] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 823c6679-501c-4ec2-9d9f-f49b7cc1205d is going to be deleted. [ 1584.789062] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.789264] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.789352] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.789470] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e307bb5-2c7b-4260-88ec-90f13f2de5d2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.789619] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.789765] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.789840] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.789947] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ce980c1-0c92-48ab-930f-2537a5f82269" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.790409] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.790574] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.790656] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.790771] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-56c2fe94-2993-4f31-a331-b0611a88cec2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.790896] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.791047] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.791124] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.791232] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65fb79f7-95e7-4be9-b5bb-64c57bc42333" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.791356] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.791494] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.791566] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.791666] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-008501d4-938b-4336-9c1d-ef3665f7d09d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.791783] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.791916] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.791987] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.792097] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-74f7fdee-99f0-4620-9ae9-86ee28797058" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.844826] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.844826] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.844826] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.844826] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.844826] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.844826] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40ac1d9f-7f09-4603-ba34-b3f5910e1da2" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.858375] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.858527] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.858527] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.858710] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.858795] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.858911] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f130eeb-c453-4570-b0fe-743f47890102" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.865183] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.865294] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.865361] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.865530] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.865612] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.865726] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c12eaa8a-f278-4d51-a697-9547755f428e" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.922116] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.922283] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.922331] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.922527] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.922618] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.922738] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-823c6679-501c-4ec2-9d9f-f49b7cc1205d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.973279] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('deac542f-a57c-4417-81fe-e14b4566b543',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1584.993467] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f6403698-8563-49d1-9b04-d2bd0547964d: rpc.has_security_group_logging(os_id): False [ 1585.029338] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.029475] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.029530] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.029732] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.067998] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.068275] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.068386] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.068452] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.068638] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.068734] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.068825] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6403698-8563-49d1-9b04-d2bd0547964d is going to be updated. [ 1585.158368] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.158586] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.158586] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.158780] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.158920] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.173090] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6403698-8563-49d1-9b04-d2bd0547964d in Status: IN_PROGRESS for 2s [ 1585.476744] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for deac542f-a57c-4417-81fe-e14b4566b543: rpc.has_security_group_logging(os_id): False [ 1585.496247] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.496474] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.496536] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.496780] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.515321] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.515598] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.515712] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.515778] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.515965] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.516062] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.516157] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: deac542f-a57c-4417-81fe-e14b4566b543 is going to be updated. [ 1585.568125] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.568293] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.568409] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.568513] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.568654] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.580967] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: deac542f-a57c-4417-81fe-e14b4566b543 in Status: IN_PROGRESS for 2s [ 1587.186681] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6403698-8563-49d1-9b04-d2bd0547964d in Status: SUCCESS [ 1587.187067] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.608092] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: deac542f-a57c-4417-81fe-e14b4566b543 in Status: SUCCESS [ 1587.608319] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1588.923398] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1588.923753] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1593.924808] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1593.925303] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1598.925938] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1598.926389] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1603.748541] env[69506]: INFO networking_nsxv3.common.synchronization [req-440605b4-e5e8-4cbc-8a50-16a908a13723 req-696b0b9b-25d4-407f-b0c1-fbb5945f5941 tempest-ServerActionsTestOtherA-1202948283 tempest-ServerActionsTestOtherA-1202948283-project-member] Enqueued Resource ID: f6403698-8563-49d1-9b04-d2bd0547964d with Priority: HIGHEST for action security_group_members [ 1603.749175] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6403698-8563-49d1-9b04-d2bd0547964d with Priority: HIGHEST for action security_group_members [ 1603.749439] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6403698-8563-49d1-9b04-d2bd0547964d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.749560] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.749625] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.749830] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.749980] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.750095] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.750156] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.750307] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.750391] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.750549] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6403698-8563-49d1-9b04-d2bd0547964d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1604.253544] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f6403698-8563-49d1-9b04-d2bd0547964d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1604.755733] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f6403698-8563-49d1-9b04-d2bd0547964d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1605.259102] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1605.259333] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1605.259333] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1605.259530] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1605.259638] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1605.259741] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6403698-8563-49d1-9b04-d2bd0547964d is going to be updated. [ 1605.290156] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1605.290347] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1605.290347] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1605.290539] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1605.290676] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1605.299899] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6403698-8563-49d1-9b04-d2bd0547964d in Status: IN_PROGRESS for 2s [ 1607.311498] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6403698-8563-49d1-9b04-d2bd0547964d in Status: SUCCESS [ 1607.311899] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1608.751026] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1608.751026] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1613.751623] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1613.752023] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1618.752635] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1618.753121] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1619.062138] env[69506]: INFO networking_nsxv3.common.synchronization [req-7d2422b4-b228-416a-9e78-74a0d182fdf9 req-1de0c75b-8089-4720-b7f5-81dd699d8e44 tempest-ServerActionsTestOtherA-1202948283 tempest-ServerActionsTestOtherA-1202948283-project-member] Enqueued Resource ID: f6403698-8563-49d1-9b04-d2bd0547964d with Priority: HIGHEST for action security_group_members [ 1619.062657] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6403698-8563-49d1-9b04-d2bd0547964d with Priority: HIGHEST for action security_group_members [ 1619.062963] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6403698-8563-49d1-9b04-d2bd0547964d taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1619.063090] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1619.063159] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1619.063359] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1619.063509] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1619.063641] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1619.063684] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1619.063807] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1619.063892] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1619.063984] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6403698-8563-49d1-9b04-d2bd0547964d',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1619.566776] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1619.566992] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1619.566992] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1619.567186] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1619.567272] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1619.567472] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1619.567598] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1619.567760] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1619.567823] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1619.567875] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1619.567949] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6403698-8563-49d1-9b04-d2bd0547964d is going to be updated. [ 1619.595965] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1619.596147] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1619.596201] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1619.596348] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1619.596477] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1619.604495] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6403698-8563-49d1-9b04-d2bd0547964d in Status: IN_PROGRESS for 2s [ 1621.614934] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6403698-8563-49d1-9b04-d2bd0547964d in Status: SUCCESS [ 1621.615331] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6403698-8563-49d1-9b04-d2bd0547964d deletion is rescheduled due to dependency. [ 1621.615331] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6403698-8563-49d1-9b04-d2bd0547964d" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1624.064061] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1624.064321] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1624.501938] env[69506]: INFO networking_nsxv3.common.synchronization [req-0ad054f3-5759-4c57-bb93-b918ef335f0a req-c2d1cad1-9f0a-4278-af43-c2a0f212f7fe tempest-AttachVolumeShelveTestJSON-1092512781 tempest-AttachVolumeShelveTestJSON-1092512781-project-member] Enqueued Resource ID: deac542f-a57c-4417-81fe-e14b4566b543 with Priority: HIGHEST for action security_group_members [ 1624.502352] env[69506]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deac542f-a57c-4417-81fe-e14b4566b543 with Priority: HIGHEST for action security_group_members [ 1624.502650] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock member-deac542f-a57c-4417-81fe-e14b4566b543 taken with stack trace [, , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.502767] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.502837] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1624.503135] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1624.503339] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1624.504027] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1624.504027] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1624.504027] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1624.504217] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1624.504328] env[69506]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('deac542f-a57c-4417-81fe-e14b4566b543',) {} {{(pid=69506) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1625.008269] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1625.008426] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1625.008478] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1625.008696] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1625.008788] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.008975] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1625.009088] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1625.009152] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1625.009298] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1625.009373] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.009461] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: deac542f-a57c-4417-81fe-e14b4566b543 is going to be updated. [ 1625.036303] env[69506]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69506) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1625.036457] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1625.036506] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1625.036685] env[69506]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1625.036813] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.044423] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: deac542f-a57c-4417-81fe-e14b4566b543 in Status: IN_PROGRESS for 2s [ 1627.054863] env[69506]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: deac542f-a57c-4417-81fe-e14b4566b543 in Status: SUCCESS [ 1627.055256] env[69506]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: deac542f-a57c-4417-81fe-e14b4566b543 deletion is rescheduled due to dependency. [ 1627.055256] env[69506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-deac542f-a57c-4417-81fe-e14b4566b543" {{(pid=69506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1629.503430] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1629.503794] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1634.504334] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1634.504707] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1639.505405] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1639.505793] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1644.506992] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1644.507393] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1649.508847] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1649.509246] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1654.510183] env[69506]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1654.510616] env[69506]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0